? The overarching goal of the proposed research is to understand how the brain performs cognitive control. By cognitive control, we mean the ability of the cognitive system to flexibly control its own behavior in response to task demands or other contingencies, favoring the processing of task-relevant information over other sources of competing information, and mediating task-relevant behavior over habitual or otherwise prepotent responses. There is virtually universal agreement that the prefrontal cortex (PFC) plays a critical role in cognitive control. However, exactly what it does and how it does it, in terms of concrete neural mechanisms, remain considerably more controversial questions. Explicit computational models that incorporate biological mechanisms can provide a powerful means of testing theoretical ideas about the biological basis of cognitive control. However, existing models have each only simulated one or a few phenomena, leaving open questions about their general applicability across the entire domain of cognitive control. We propose to address this limitation by applying a single computational model that includes critical features of the underlying neurobiology (including the basal ganglia (BG) and its interactions with the PFC) to a wide range of benchmark behavioral and neural phenomena. This model includes powerful learning mechanisms that should produce intelligent, controlled behavior without relying on the kind of homunculus that often lies behind theories of cognitive control.
Specific Aim 1 : Modeling Behavioral and Neural Data. We test the sufficiency of our framework by evaluating whether a single instantiation of the model, trained on a single large corpus of tasks, can simulate a wide range of benchmark data in cognitive control, and we use this model to make a number of testable predictions.
Specific Aim 2 : Nature and Learning of PFC/BG Representations. We address the fundamental question: how can people quickly adapt to performing novel cognitive tasks, when it takes monkeys months of highly-focused training to learn a single new task? We hypothesize that people develop an extensive repertoire of basic cognitive operations throughout the long developmental period into adulthood, and can rapidly and flexibly combine them to solve novel tasks. Demonstrating this principle in an explicit computational model will have important implications for understanding human intelligence, education, and development. ? ? ? ? ? ?
| Pauli, Wolfgang M; O'Reilly, Randall C; Yarkoni, Tal et al. (2016) Regional specialization within the human striatum for diverse psychological functions. Proc Natl Acad Sci U S A 113:1907-12 |
| Pauli, Wolfgang M; Hazy, Thomas E; O'Reilly, Randall C (2012) Expectancy, ambiguity, and behavioral flexibility: separable and complementary roles of the orbital frontal cortex and amygdala in processing reward expectancies. J Cogn Neurosci 24:351-66 |
| Reynolds, Jeremy R; O'Reilly, Randall C; Cohen, Jonathan D et al. (2012) The function and organization of lateral prefrontal cortex: a test of competing hypotheses. PLoS One 7:e30284 |
| Hazy, Thomas E; Frank, Michael J; O'Reilly, Randall C (2010) Neural mechanisms of acquired phasic dopamine responses in learning. Neurosci Biobehav Rev 34:701-20 |
| Reynolds, Jeremy R; O'Reilly, Randall C (2009) Developing PFC representations using reinforcement learning. Cognition 113:281-92 |
| Pauli, Wolfgang M; O'Reilly, Randall C (2008) Attentional control of associative learning--a possible role of the central cholinergic system. Brain Res 1202:43-53 |
| Aisa, Brad; Mingus, Brian; O'Reilly, Randy (2008) The emergent neural modeling system. Neural Netw 21:1146-52 |
| Frank, Michael J; Santamaria, Amy; O'Reilly, Randall C et al. (2007) Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorder. Neuropsychopharmacology 32:1583-99 |
| O'Reilly, Randall C; Frank, Michael J; Hazy, Thomas E et al. (2007) PVLV: the primary value and learned value Pavlovian learning algorithm. Behav Neurosci 121:31-49 |
| Atallah, Hisham E; Lopez-Paniagua, Dan; Rudy, Jerry W et al. (2007) Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nat Neurosci 10:126-31 |
Showing the most recent 10 out of 19 publications
