As we encounter stimuli in the environment, we make predictions about their value. When outcomes fail to match these predictions, we update our predictions to reflect new experience. This learning process is thought to involve midbrain dopamine (DA) neurons, which encode prediction errors, or the difference between actual and expected reward. Besides contributing to learning, prediction errors may lie at the core of many mental illnesses, including addiction (where drug rewards are overvalued) and depression (where previously pleasurable activities no longer feel rewarding). Although much work has gone into characterizing the responses of DA neurons to reward and punishment, less is known about how DA neurons calculate these responses, and in particular, how predictions are conveyed. Recently, it was suggested that GABAergic neurons in the ventral tegmental area might relay information to neighboring DA neurons about the predicted value of cues. By sustaining activity from the onset of a reward-predicting cue to the time of expected reward, these inhibitory neurons might provide DA neurons with information they need to calculate prediction errors. This project will use optogenetics, electrophysiology, and reversible lesions to test this theory. In the first part, the inhibitory expectation signal will be eliminated on a trial-by-trial basis while the activity of DA neurons is recorded. Without the expectation signal, DA neurons should respond robustly to rewards, even when they are fully predicted. In the second part, the origin of the expectation signal will be probed through reversible inactivation of the orbitofrontal cortex (OFC). If the OFC helps drive the GABA expectation signal, then inactivating OFC should eliminate this signal in GABA cells, and cause DA neurons to respond in the same way to expected and unexpected reward. Together, these experiments will shed light on how dopamine neurons calculate prediction errors, and identify possible points of vulnerability in this system.
Deficits in the dopamine system are associated with serious mental illnesses, including addiction, depression, and schizophrenia. This proposal uses an interdisciplinary approach to study how dopamine release is regulated, with the ultimate goal of identifying points of vulnerability and resilience in this system.
| Eshel, Neir; Tian, Ju; Bukwich, Michael et al. (2016) Dopamine neurons share common response function for reward prediction error. Nat Neurosci 19:479-86 |
| Eshel, Neir; Marcovitz, David E; Stern, Theodore A (2016) Psychiatric Consultations in Less-Than-Private Places: Challenges and Unexpected Benefits of Hospital Roommates. Psychosomatics 57:97-101 |
| Huys, Quentin J M; Lally, Níall; Faulkner, Paul et al. (2015) Interplay of approximate planning strategies. Proc Natl Acad Sci U S A 112:3098-103 |
| Eshel, Neir; Bukwich, Michael; Rao, Vinod et al. (2015) Arithmetic and local circuitry underlying dopamine prediction errors. Nature 525:243-6 |
| Eshel, Neir; Tian, Ju (2014) Dopamine gates sensory representations in cortex. J Neurophysiol 111:2161-3 |
| Eshel, Neir; Tian, Ju; Uchida, Naoshige (2013) Opening the black box: dopamine, predictions, and learning. Trends Cogn Sci 17:430-1 |
