A striking range of mental disorders, from OCD to schizophrenia, is accompanied by aberrant decision-making and also by dysfunction in the dopamine system and its targets in the forebrain. Although celebrated computational work posits roles for this system together with the posterior parietal cortex in learning and decision-making for simple choice problems, it requires a tremendous leap of faith to imagine how these simple computational mechanisms can be """"""""scaled up"""""""" from the laboratory to address real-world human behavior of the sort that is clinically problematic for patients with these disorders. One understudied aspect of this problem is the high dimensionality of the space of candidate actions, notably the involvement of multiple effectors such as hands and eyes. This project proposes a theoretical framework for more realistic learning and decision problems involving multiple effectors, and leverages it in experiments probing how the brain copes with learning and decision-making in these cases. The core idea is that the brain should divide-and-conquer: treating, e.g., hand and eye movements independently to simplify learning when their consequences are independent, but that it must evaluate actions jointly across effectors when this is not the case. Learning tasks manipulating this independence are used to: (1) test whether humans and animals learn to solve decision problems by separating or coordinating effector choices to efficiently harvest rewards;these tasks are combined with electrophysiological recordings and fMRI to (2) test whether separate or conjoint neural value maps are maintained for action values across effectors, as appropriate to the problem;and multiarea recordings are used to (3) test whether coordinated choices increase neural interactions between effector-specific motor maps. The work makes innovative use of computational theory for experimental design and analysis, in order to connect experimental observations across species, measurement types (spiking, local field potentials, fMRI), and scales (neuronal, systems). It also introduces a new laboratory microcosm for the computations needed to scale up existing decision theories toward clinically relevant real-world behaviors. In principle, quantitative theories of the brain's decision and learning systems hold important promise for the numerous serious mental illnesses that center around these systems, such as improved procedures for diagnosis or screening candidate treatments. This project aims to """"""""scale up"""""""" such theories -- which are, in practice, too simple to deliver on this promise -- toward explaining the interacting neural circuits that control realistic behaviors more like those that are problematic for patients with mental illnesses.

Agency
National Institute of Health (NIH)
Institute
National Institute of Mental Health (NIMH)
Type
Research Project (R01)
Project #
1R01MH087882-01
Application #
7779551
Study Section
Special Emphasis Panel (ZRG1-IFCN-B (50))
Program Officer
Glanzman, Dennis L
Project Start
2009-09-01
Project End
2014-04-30
Budget Start
2009-09-01
Budget End
2010-04-30
Support Year
1
Fiscal Year
2009
Total Cost
$359,220
Indirect Cost
Name
New York University
Department
Neurology
Type
Schools of Arts and Sciences
DUNS #
041968306
City
New York
State
NY
Country
United States
Zip Code
10012
Wong, Yan T; Fabiszak, Margaret M; Novikov, Yevgeny et al. (2016) Coherent neuronal ensembles are rapidly recruited when making a look-reach decision. Nat Neurosci 19:327-34
Otto, A Ross; Skatova, Anya; Madlon-Kay, Seth et al. (2015) Cognitive control predicts use of model-based reinforcement learning. J Cogn Neurosci 27:319-33
Constantino, Sara M; Daw, Nathaniel D (2015) Learning the opportunity cost of time in a patch-foraging task. Cogn Affect Behav Neurosci 15:837-53
Madlon-Kay, Seth; Pesaran, Bijan; Daw, Nathaniel D (2013) Action selection in multi-effector decision making. Neuroimage 70:66-79
Otto, A Ross; Raio, Candace M; Chiang, Alice et al. (2013) Working-memory capacity protects model-based learning from stress. Proc Natl Acad Sci U S A 110:20941-6
Doll, Bradley B; Simon, Dylan A; Daw, Nathaniel D (2012) The ubiquity of model-based reinforcement learning. Curr Opin Neurobiol 22:1075-81
Bornstein, Aaron M; Daw, Nathaniel D (2012) Dissociating hippocampal and striatal contributions to sequential prediction learning. Eur J Neurosci 35:1011-23
Dean, Heather L; Hagan, Maureen A; Pesaran, Bijan (2012) Only coherent spiking in posterior parietal cortex coordinates looking and reaching. Neuron 73:829-41
Wong, Yan T; Hagan, Maureen A; Markowitz, David A et al. (2011) The tracking of reaches in three-dimensions. Conf Proc IEEE Eng Med Biol Soc 2011:5440-3
Bornstein, Aaron M; Daw, Nathaniel D (2011) Multiplicity of control in the basal ganglia: computational roles of striatal subregions. Curr Opin Neurobiol 21:374-80

Showing the most recent 10 out of 20 publications