Representation of negative motivational value in the primate lateral habenula: An action may lead to either a reward or a punishment. Therefore, an appropriate action needs to be chosen on the basis of the values of both expected rewards and expected punishments. To understand the underlying neural mechanisms, we conditioned monkeys using a Pavlovian procedure with two distinct contexts: one in which rewards were available and another in which punishments were feared. We found that the population of lateral habenula neurons was most strongly excited by a conditioned stimulus associated with the most unpleasant event in each context: the absence of the reward or the presence of the punishment. The population of lateral habenula neurons was also excited by the punishment itself and inhibited by the reward itself, especially when they were less predictable. These results suggest that the lateral habenula has the potential to adaptively control both reward-seeking and punishment-avoidance behaviors, presumably through its projections to dopaminergic and serotonergic systems. Two types of dopamine neuron distinctly convey positive and negative motivational signals: Midbrain dopamine neurons are activated by reward or sensory stimuli predicting reward. These excitatory responses increase as the reward value increases. This response property has led to a hypothesis that dopamine neurons encode value-related signals and are inhibited by aversive events. Here we show that this is true only for a subset of dopamine neurons. We recorded the activity of dopamine neurons in monkeys during a Pavlovian procedure with appetitive and aversive outcomes. We found that some dopamine neurons were excited by rewardpredicting stimuli and inhibited by airpuff-predicting stimuli, as the value hypothesis predicts. However, a greater number of dopamine neurons were excited by both of these stimuli, inconsistent with the hypothesis. Some dopamine neurons were also excited by both rewards and airpuffs themselves, especially when they were unpredictable. Neurons excited by the airpuff-predicting stimuli were located more dorsolaterally in the substantia nigra pars compacta, whereas neurons inhibited by the stimuli were located more ventromedially, some in the ventral tegmental area. A similar anatomical difference was observed for their responses to actual airpuffs. These findings suggest that different groups of dopamine neurons convey motivational signals in distinct manners. Midbrain dopamine neurons signal preference for advance information about upcoming rewards: The desire to know what the future holds is a powerful motivator in everyday life, but it is unknown how this desire is created by neurons in the brain. Here we show that when macaque monkeys are offered a water reward of variable magnitude, they seek advance information about its size. Furthermore, the same midbrain dopamine neurons that signal the expected amount of water also signal the expectation of information, in a manner that is correlated with the strength of the animals preference. Our data show that single dopamine neurons process both primitive and cognitive rewards, and suggest that current theories of reward-seeking must be revised to include information-seeking.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Investigator-Initiated Intramural Research Projects (ZIA)
Project #
1ZIAEY000415-07
Application #
7968349
Study Section
Project Start
Project End
Budget Start
Budget End
Support Year
7
Fiscal Year
2009
Total Cost
$508,369
Indirect Cost
Name
U.S. National Eye Institute
Department
Type
DUNS #
City
State
Country
Zip Code
Ghazizadeh, Ali; Hong, Simon; Hikosaka, Okihide (2018) Prefrontal Cortex Represents Long-Term Memory of Object Values for Months. Curr Biol 28:2206-2217.e5
Ghazizadeh, Ali; Griggs, Whitney; Leopold, David A et al. (2018) Temporal-prefrontal cortical network for discrimination of valuable objects in long-term memory. Proc Natl Acad Sci U S A 115:E2135-E2144
Griggs, Whitney S; Amita, Hidetoshi; Gopal, Atul et al. (2018) Visual Neurons in the Superior Colliculus Discriminate Many Objects by Their Historical Values. Front Neurosci 12:396
Maeda, Kazutaka; Kunimatsu, Jun; Hikosaka, Okihide (2018) Amygdala activity for the modulation of goal-directed behavior in emotional contexts. PLoS Biol 16:e2005339
Hikosaka, Okihide; Kim, Hyoung F; Amita, Hidetoshi et al. (2018) Direct and indirect pathways for choosing objects and actions. Eur J Neurosci :
Amita, Hidetoshi; Kim, Hyoung F; Smith, Mitchell K et al. (2018) Neuronal connections of direct and indirect pathways for stable value memory in caudal basal ganglia. Eur J Neurosci :
Kim, Hyoung F; Amita, Hidetoshi; Hikosaka, Okihide (2017) Indirect Pathway of Caudal Basal Ganglia for Rejection of Valueless Visual Objects. Neuron 94:920-930.e3
Hikosaka, Okihide; Ghazizadeh, Ali; Griggs, Whitney et al. (2017) Parallel basal ganglia circuits for decision making. J Neural Transm (Vienna) :
Griggs, Whitney S; Kim, Hyoung F; Ghazizadeh, Ali et al. (2017) Flexible and Stable Value Coding Areas in Caudate Head and Tail Receive Anatomically Distinct Cortical and Subcortical Inputs. Front Neuroanat 11:106
Yasuda, Masaharu; Hikosaka, Okihide (2017) To Wait or Not to Wait-Separate Mechanisms in the Oculomotor Circuit of Basal Ganglia. Front Neuroanat 11:35

Showing the most recent 10 out of 60 publications