The Actor/Critic model has been suggested to be the computational solution to optimizing long term gains. In this model, decisions made by the Actor are updated by the Critic when outcomes deviate from what is expected. Past research shows that midbrain dopamine (DA) neurons signal errors in reward prediction;however, it is unknown how these signals are generated or how they impact decision policies in downstream brains areas. According to the Actor/Critic model, midbrain DA neurons compute prediction errors by comparing the predicted value of reward, signaled by ventral striatum (VS), to the actual value of reward received, but this has not been directly tested. Subsequently, prediction errors are thought to modify behavior by updating the action policies of the Actor, dorsal striatum (DS). Neural correlates in DS include policies related to stimuli, responses and outcomes, but how these correlates are modulated by the DA system during learning remains unknown. Here, these issues will be addressed by recording from single neurons in DS and midbrain DA neurons after DA and VS inactivation, respectively. The importance of these interactions will be verified by inactivation techniques. Importantly, this circuit has been shown to be abnormal in addiction, which makes sense, considering that addicts cannot optimize choice behavior in the face of changing consequences. A final experiment will examine neural correlates of reward predictions, prediction errors and decision policies in rats that have chronically self-administered cocaine;the results will help determine how these neural representations are disrupted after long-term drug exposure.

Public Health Relevance

Optimal decision-making is thought to depend on a circuit involving striatum and midbrain dopamine neurons;areas affected by long-term exposure to drugs of abuse. Together, these brain regions are thought to compute errors in reward prediction, which are subsequently used to update policies that guide future decisions. Improving our understanding of the neural mechanisms underlying the decision making process will provide a better working knowledge of how we learn normally and how this circuit is affected by chronic drug use.

Agency
National Institute of Health (NIH)
Institute
National Institute on Drug Abuse (NIDA)
Type
Research Project (R01)
Project #
5R01DA031695-02
Application #
8280446
Study Section
Cognitive Neuroscience Study Section (COG)
Program Officer
Volman, Susan
Project Start
2011-07-01
Project End
2016-04-30
Budget Start
2012-05-01
Budget End
2013-04-30
Support Year
2
Fiscal Year
2012
Total Cost
$301,275
Indirect Cost
$76,275
Name
University of Maryland College Park
Department
Psychology
Type
Schools of Arts and Sciences
DUNS #
790934285
City
College Park
State
MD
Country
United States
Zip Code
20742
Bissonette, G B; Roesch, M R (2016) Development and function of the midbrain dopamine system: what we know and what we need to. Genes Brain Behav 15:62-73
Bissonette, G B; Roesch, M R (2016) Neurophysiology of rule switching in the corticostriatal circuit. Neuroscience :
Bissonette, Gregory B; Roesch, Matthew R (2016) Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action. Curr Top Behav Neurosci 27:199-230
Bryden, Daniel W; Burton, Amanda C; Barnett, Brian R et al. (2016) Prenatal Nicotine Exposure Impairs Executive Control Signals in Medial Prefrontal Cortex. Neuropsychopharmacology 41:716-25
Burton, Amanda C; Nakamura, Kae; Roesch, Matthew R (2015) From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making. Neurobiol Learn Mem 117:51-9
Hernandez, Alex; Burton, Amanda C; O'Donnell, Patricio et al. (2015) Altered basolateral amygdala encoding in an animal model of schizophrenia. J Neurosci 35:6394-400
Bissonette, Gregory B; Schoenbaum, Geoffrey; Roesch, Matthew R et al. (2015) Interneurons are necessary for coordinated activity during reversal learning in orbitofrontal cortex. Biol Psychiatry 77:454-64
Bryden, Daniel W; Roesch, Matthew R (2015) Executive control signals in orbitofrontal cortex during response inhibition. J Neurosci 35:3903-14
Bissonette, Gregory B; Roesch, Matthew R (2015) Rule encoding in dorsal striatum impacts action selection. Eur J Neurosci 42:2555-67
Kashtelyan, Vadim; Lichtenberg, Nina T; Chen, Mindy L et al. (2014) Observation of reward delivery to a conspecific modulates dopamine release in ventral striatum. Curr Biol 24:2564-8

Showing the most recent 10 out of 26 publications