Classical conditioning is arguably the most fundamental tool we possess for adapting our behavior to a changing environment. Appetitive classical conditioning can be thought of as the process that establishes a learned association between reinforcement and the stimuli in the environment that signal its availability. This form of """"""""reinforcement learning"""""""" provides organisms with a potent means to use predictive information to mold and guide preparatory action in an effort to maximize reward. The past three decades have been marked by major advances in our understanding of the neurobiological mechanisms that underlie reinforcement learning. In particular, short """"""""phasic"""""""" bursts of neuronal activity in dopamine neurons, which are thought to produce rapid and transient increases in extracellular dopamine concentration throughout the striatum, have received considerable attention as a necessary component of the reinforcement process for both natural and drug reward. The central dogma in catecholamine research has held that dopamine transmission proceeds as a uniform broadcast signal from the midbrain to all target structures in the forebrain. However, there is mounting evidence that separate nuclei within the striatum may receive differential signals in response to primary rewards and conditioned cues at different stages in the learning process. It is hypothesized that this regional specificity in the dynamics and stability of dopamine signaling corresponds to the largely segregated roles in both learning and behavioral control that dopamine may play in these structures. The current proposal will test these hypotheses with three specific aims.
Aim 1 will examine the impact of learning history and specific features of the task on the stability of phasic dopamine in the ventral striatum.
Aim 2 will examine the influence of phasic dopamine on the activation of the striatum during different stages of learning and assess the coincident regional control of behavior.
Aim 3 will examine phasic dopamine release in the ventral and dorsal striatum during multiple stages of reinforcement learning (acquisition, extended training and extinction) with the goal of correlating and comparing the development of specific behaviors to the profile of phasic signaling in each structure.

Public Health Relevance

Although adaptive under normal circumstances, reinforcement learning is one of several contributing factors to the powerful control drug-related stimuli have over drug-seeking and drug-taking behaviors in many models of addiction. The phasic activation of the neuromodulator dopamine is implicated in both reinforcement learning and many aspects of drug abuse. The primary goal of this proposal is to examine the contribution of phasic dopamine release in specific brain regions to reinforcement and behavioral control.

Agency
National Institute of Health (NIH)
Institute
National Institute on Drug Abuse (NIDA)
Type
Research Project (R01)
Project #
5R01DA027858-04
Application #
8265648
Study Section
Neurobiology of Motivated Behavior Study Section (NMB)
Program Officer
Sorensen, Roger
Project Start
2009-09-30
Project End
2014-05-31
Budget Start
2012-06-01
Budget End
2013-05-31
Support Year
4
Fiscal Year
2012
Total Cost
$299,614
Indirect Cost
$107,554
Name
University of Washington
Department
Psychiatry
Type
Schools of Medicine
DUNS #
605799469
City
Seattle
State
WA
Country
United States
Zip Code
98195
Fonzi, Kaitlyn M; Lefner, Merridee J; Phillips, Paul E M et al. (2017) Dopamine Encodes Retrospective Temporal Information in a Context-Independent Manner. Cell Rep 20:1765-1774
Hart, Andrew S; Clark, Jeremy J; Phillips, Paul E M (2015) Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning. Neurobiol Learn Mem 117:84-92
Wassum, Kate M; Phillips, Paul E M (2015) Probing the neurochemical correlates of motivation and decision making. ACS Chem Neurosci 6:11-3
Goertz, Richard Brandon; Wanat, Matthew J; Gomez, Jorge A et al. (2015) Cocaine increases dopaminergic neuron and motor activity via midbrain ?1 adrenergic signaling. Neuropsychopharmacology 40:1151-62
Hart, Andrew S; Rutledge, Robb B; Glimcher, Paul W et al. (2014) Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J Neurosci 34:698-704
Willuhn, Ingo; Burgeno, Lauren M; Groblewski, Peter A et al. (2014) Excessive cocaine use results from decreased phasic dopamine signaling in the striatum. Nat Neurosci 17:704-9
Hollon, Nick G; Arnold, Monica M; Gan, Jerylin O et al. (2014) Dopamine-associated cached values are not sufficient as the basis for action selection. Proc Natl Acad Sci U S A 111:18357-62
Willuhn, Ingo; Tose, Amanda; Wanat, Matthew J et al. (2014) Phasic dopamine release in the nucleus accumbens in response to pro-social 50 kHz ultrasonic vocalizations in rats. J Neurosci 34:10616-23
Howe, Mark W; Tierney, Patrick L; Sandberg, Stefan G et al. (2013) Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500:575-9
Clark, Jeremy J; Collins, Anne L; Sanford, Christina Akers et al. (2013) Dopamine encoding of Pavlovian incentive stimuli diminishes with extended training. J Neurosci 33:3526-32

Showing the most recent 10 out of 16 publications