The Actor/Critic model has been suggested to be the computational solution to optimizing long term gains. In this model, decisions made by the Actor are updated by the Critic when outcomes deviate from what is expected. Past research shows that midbrain dopamine (DA) neurons signal errors in reward prediction;however, it is unknown how these signals are generated or how they impact decision policies in downstream brains areas. According to the Actor/Critic model, midbrain DA neurons compute prediction errors by comparing the predicted value of reward, signaled by ventral striatum (VS), to the actual value of reward received, but this has not been directly tested. Subsequently, prediction errors are thought to modify behavior by updating the action policies of the Actor, dorsal striatum (DS). Neural correlates in DS include policies related to stimuli, responses and outcomes, but how these correlates are modulated by the DA system during learning remains unknown. Here, these issues will be addressed by recording from single neurons in DS and midbrain DA neurons after DA and VS inactivation, respectively. The importance of these interactions will be verified by inactivation techniques. Importantly, this circuit has been shown to be abnormal in addiction, which makes sense, considering that addicts cannot optimize choice behavior in the face of changing consequences. A final experiment will examine neural correlates of reward predictions, prediction errors and decision policies in rats that have chronically self-administered cocaine;the results will help determine how these neural representations are disrupted after long-term drug exposure.

Public Health Relevance

Optimal decision-making is thought to depend on a circuit involving striatum and midbrain dopamine neurons;areas affected by long-term exposure to drugs of abuse. Together, these brain regions are thought to compute errors in reward prediction, which are subsequently used to update policies that guide future decisions. Improving our understanding of the neural mechanisms underlying the decision making process will provide a better working knowledge of how we learn normally and how this circuit is affected by chronic drug use.

Agency
National Institute of Health (NIH)
Institute
National Institute on Drug Abuse (NIDA)
Type
Research Project (R01)
Project #
5R01DA031695-02
Application #
8280446
Study Section
Cognitive Neuroscience Study Section (COG)
Program Officer
Volman, Susan
Project Start
2011-07-01
Project End
2016-04-30
Budget Start
2012-05-01
Budget End
2013-04-30
Support Year
2
Fiscal Year
2012
Total Cost
$301,275
Indirect Cost
$76,275
Name
University of Maryland College Park
Department
Psychology
Type
Schools of Arts and Sciences
DUNS #
790934285
City
College Park
State
MD
Country
United States
Zip Code
20742
Burton, Amanda C; Nakamura, Kae; Roesch, Matthew R (2015) From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making. Neurobiol Learn Mem 117:51-9
Bissonette, Gregory B; Schoenbaum, Geoffrey; Roesch, Matthew R et al. (2015) Interneurons are necessary for coordinated activity during reversal learning in orbitofrontal cortex. Biol Psychiatry 77:454-64
Burton, Amanda C; Bissonette, Gregory B; Lichtenberg, Nina T et al. (2014) Ventral striatum lesions enhance stimulus and response encoding in dorsal striatum. Biol Psychiatry 75:132-9
Lichtenberg, N T; Kashtelyan, V; Burton, A C et al. (2014) Nucleus accumbens core lesions enhance two-way active avoidance. Neuroscience 258:340-6
Bissonette, Gregory B; Burton, Amanda C; Gentry, Ronny N et al. (2013) Separate populations of neurons in ventral striatum encode value and motivation. PLoS One 8:e64673
Bissonette, Gregory B; Powell, Elizabeth M; Roesch, Matthew R (2013) Neural structures underlying set-shifting: roles of medial prefrontal cortex and anterior cingulate cortex. Behav Brain Res 250:91-101
Goldstein, Brandon L; Barnett, Brian R; Vasquez, Gloria et al. (2012) Ventral striatum encodes past and predicted value independent of motor contingencies. J Neurosci 32:2027-36
Kashtelyan, Vadim; Tobia, Steven C; Burton, Amanda C et al. (2012) Basolateral amygdala encodes upcoming errors but not response conflict. Eur J Neurosci 35:952-9
Bryden, Daniel W; Johnson, Emily E; Tobia, Steven C et al. (2011) Attention for learning signals in anterior cingulate cortex. J Neurosci 31:18266-74