Robust representation of stable object values in the oculomotor basal ganglia: Our gaze tends to be directed to objects previously associated with rewards. Such object values change flexibly or remain stable. Here we present evidence that the monkey substantia nigra pars reticulata (SNr) in the basal ganglia represents stable, rather than flexible, object values. After across-day learning of objectreward association, SNr neurons gradually showed a response bias to surprisingly many visual objects: inhibition to high-valued objects and excitation to low-valued objects. Many of these neurons were shown to project to the ipsilateral superior colliculus. This neuronal bias remained intact even after 100 d without further learning. In parallel with the neuronal bias, the monkeys tended to look at high-valued objects. The neuronal and behavioral biases were present even if no value was associated during testing. These results suggest that SNr neurons bias the gaze toward objects that were consistently associated with high values in ones history. The primate ventral pallidum encodes expected reward value and regulates motor action: Motor actions are facilitated when expected reward value is high. It is hypothesized that there are neurons that encode expected reward values to modulate impending actions and potentially represent motivation signals. Here, we present evidence suggesting that the ventral pallidum (VP) may participate in this process. We recorded single neuronal activity in the monkey VP using a saccade task with a direction-dependent reward bias. Depending on the amount of the expected reward, VP neurons increased or decreased their activity tonically until the reward was delivered, for both ipsiversive and contraversive saccades. Changes in expected reward values were also associated with changes in saccade performance (latency and velocity). Furthermore, bilateral muscimol-induced inactivation of the VP abolished the reward-dependent changes in saccade latencies. These data suggest that the VP provides expected reward value signals that are used to facilitate or inhibit motor actions. Selective and graded coding of reward uncertainty by neurons in the primate anterodorsal septal region: Natural environments are uncertain. Uncertainty of emotional outcomes can induce anxiety and raise vigilance, promote and signal the opportunity for learning, modulate economic choice and regulate risk-seeking. Here we demonstrate that a subset of neurons in the anterodorsal region of the primate septum (ADS) are primarily devoted to processing uncertainty in a highly specific manner. Those neurons were selectively activated by visual cues indicating probabilistic delivery of reward (for example, 25%, 50% and 75% reward) and did not respond to cues indicating certain outcomes (0% and 100% reward). The average ADS uncertainty response was graded with the magnitude of reward uncertainty and selectively signaled uncertainty about rewards rather than punishments. The selective and graded information about reward uncertainty encoded by many neurons in the ADS may underlie modulation of uncertainty of value- and sensorimotor-related areas to regulate goal-directed behavior. Reward value-contingent changes of visual responses in the primate caudate tail associated with a visuomotor skill: A goal-directed action aiming at an incentive outcome, if repeated, becomes a skill that may be initiated automatically. We now report that the tail of the caudate nucleus (CDt) may serve to control a visuomotor skill. Monkeys looked at many fractal objects, half of which were always associated with a large reward (high-valued objects) and the other half with a small reward (low-valued objects). After several daily sessions, they developed a gaze bias, looking at high-valued objects even when no reward was associated. CDt neurons developed a response bias, typically showing stronger responses to high-valued objects. In contrast, their responses showed no change when object values were reversed frequently, although monkeys showed a strong gaze bias, looking at high-valued objects in a goal-directed manner. The biased activity of CDt neurons may be transmitted to the oculomotor region so that animals can choose high-valued objects automatically based on stable reward experiences.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Investigator-Initiated Intramural Research Projects (ZIA)
Project #
1ZIAEY000415-11
Application #
8737633
Study Section
Project Start
Project End
Budget Start
Budget End
Support Year
11
Fiscal Year
2013
Total Cost
$1,418,351
Indirect Cost
Name
U.S. National Eye Institute
Department
Type
DUNS #
City
State
Country
Zip Code
Hong, S; Hikosaka, O (2014) Pedunculopontine tegmental nucleus neurons provide reward, sensorimotor, and alerting signals to midbrain dopamine neurons. Neuroscience 282C:139-155
Daye, Pierre M; Monosov, Ilya E; Hikosaka, Okihide et al. (2013) pyElectrode: an open-source tool using structural MRI for electrode positioning and neuron mapping. J Neurosci Methods 213:123-31
Terao, Yasuo; Fukuda, Hideki; Ugawa, Yoshikazu et al. (2013) New perspectives on the pathophysiology of Parkinson's disease as assessed by saccade performance: a clinical review. Clin Neurophysiol 124:1491-506
Monosov, Ilya E; Hikosaka, Okihide (2013) Selective and graded coding of reward uncertainty by neurons in the primate anterodorsal septal region. Nat Neurosci 16:756-62
Yamamoto, Shinya; Kim, Hyoung F; Hikosaka, Okihide (2013) Reward value-contingent changes of visual responses in the primate caudate tail associated with a visuomotor skill. J Neurosci 33:11227-38
Hikosaka, Okihide; Yamamoto, Shinya; Yasuda, Masaharu et al. (2013) Why skill matters. Trends Cogn Sci 17:434-41
Bromberg-Martin, Ethan S; Hikosaka, Okihide (2009) Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 63:119-26
Matsumoto, Masayuki; Hikosaka, Okihide (2009) Representation of negative motivational value in the primate lateral habenula. Nat Neurosci 12:77-84
Matsumoto, Masayuki; Hikosaka, Okihide (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459:837-41
Isoda, Masaki; Hikosaka, Okihide (2008) A neural correlate of motivational conflict in the superior colliculus of the macaque. J Neurophysiol 100:1332-42

Showing the most recent 10 out of 19 publications