Motivation, the desire to act, is thought to arise within the limbic system. We are studying the biological basis of motivated behavior and reward expectancy in monkeys using a task that manipulates their motivation. In this task, monkeys must complete a work schedule wherein the workload varies. The work is quantified by the number of times that the monkey must detect when a red spot changes to green. The monkeys work faster and with fewer errors when a visual cue indicates that the reward will be delivered immediately after the next correct response than when the cue indicates that additional red-to-green detections will be needed. Previously we learned that single neuronal responses in the ventral striatum and perirhinal are directly related to the associatively learned meaning of the cue. More recently we have also examined the activity of neurons in the amygdala and anterior cingulate cortex. Neurons in ventral striatum keep track of whether the animal is at the beginning of or somewhere in the course of a behavioral sequence that ultimately leads to reward. Some neurons signal that a new series of trials is starting, others signal that a series of trials is in progress, and still others signal the rewarded trial is starting when it follows one or more unrewarded trials. Thus populations in both brain regions provide neural signals that could reinforce complex reward-seeking behavior. However, neither brain region showed a signal related to directly to reward expectancy. However, we found this signal in the anterior cingulate cortex where neurons respond more strongly as more trials have elapsed. This is a provocative finding because the cingulate cortex shows abnormal activation in imaging with humans having disorders of reward expectancy such as obsessive-compulsived disorder and drug abuse. In the baso-lateral complex of the amygdala in the 2 and 3 trial schedules, two types of responses occurred in the responses of single neurons; precue activity and responses starting at cue appearance in the rewarded trial. In the 1 trial schedule, these responses close enough in time so that they appear to be one response, i.e., the responses in the one trial schedule look like the two different types of activity seen in the longer schedules are abutted with each other. When the cue was shuffled to be independent of the schedule, no precue activity occurred and only a weak response was observed after cue onset. The results indicate that two different signals were coded sequentially in time. The first signal might be related to immediate expectation of the beginning of the next schedule and the second signal might be related to immediate expectation of the reward. Because of its close connections with the visual system, the rhinal cortex has been shown to be important for normal pattern recognition behavior. Rhinal cortex, amgdala, and ventral striatum are strongly interconnected, with both amygdala and ventral striatum receiving visual information from the perirhinal cortex. Given the emphasis on the relation between perirhinal cortex and pattern-recognition behavior in the past, the prominence of the perirhinal activity related to the reward schdules was unexpected. To investigate whether perirhinal cortex plays a critical role in this associately learned reward schedule related behavior, normal monkeys and monkeys with bilateral rhinal cortex lesions were studied using the reward schedule task described above. Normal monkeys associate new visual cues with the schedule starting within a single training session. In contrast, animals with bilateral rhinal cortex ablations are severely impaired in making this association, being unable to do so even after six weeks of daily training. Thus, perirhinal cortex is a critical structure for developing the associative relation between a visual cue and its meaning for reward schedules. We hypothesize that dopaminergic input provides signals sensitive to long-term progress through a planned or expected series of tasks which culminated in reward. To test this, we injected material that temporarily should block production of D2 receptor protein into the remaining rhinal cortex of monkeys with a unilateral rhinal cortex lesion. For a period of about 10 weeks these animals are unable to associate new visual cues with reward schedules, thus mimicing the results after a bilateral ablation. Animals with control injections of DNA blocking production of the NR2B subunit of the NMDA receptor perform like normal monkeys, showing that the D2 receptor is critical for this associative learning of cues predicting workload. These data suggest that rhinal cortex is critical for forming the associations between stimuli and their motivational/emotional meaning for predicting reward in reward schedules. Finally, in new experiments we have examined the responses of orbitofrontal neurons because orbitofrontal cortex is implicated in memory and evaluation of reward value. In these neuronal recordings a large proportion of the neurons respond differentially according to whether the monkey knows when the reward will be given or not. This difference persists across many trials when the monkey is instructed about when to expect the reward. It appears that all of these brain regions carry signals that might be important for the coding of reward or goal expectation and incentive.

Agency
National Institute of Health (NIH)
Institute
National Institute of Mental Health (NIMH)
Type
Intramural Research (Z01)
Project #
1Z01MH002619-12
Application #
6823866
Study Section
(LN)
Project Start
Project End
Budget Start
Budget End
Support Year
12
Fiscal Year
2003
Total Cost
Indirect Cost
Name
U.S. National Institute of Mental Health
Department
Type
DUNS #
City
State
Country
United States
Zip Code
Bouret, Sebastien; Richmond, Barry J (2009) Relation of locus coeruleus neurons in monkeys to Pavlovian and operant behaviors. J Neurophysiol 101:898-911
Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J (2009) Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys. J Neurophysiol 101:437-47
Simmons, Janine M; Saad, Ziad S; Lizak, Martin J et al. (2008) Mapping prefrontal circuits in vivo with manganese-enhanced magnetic resonance imaging in monkeys. J Neurosci 28:7637-47
Simmons, Janine M; Richmond, Barry J (2008) Dynamic changes in representations of preceding and upcoming reward in monkey orbitofrontal cortex. Cereb Cortex 18:93-103
La Camera, Giancarlo; Richmond, Barry J (2008) Modeling the violation of reward maximization and invariance in reinforcement schedules. PLoS Comput Biol 4:e1000131
Simmons, Janine M; Ravel, Sabrina; Shidara, Munetaka et al. (2007) A comparison of reward-contingent neuronal activity in monkey orbitofrontal cortex and ventral striatum: guiding actions toward rewards. Ann N Y Acad Sci 1121:376-94
Sugase-Miyamoto, Yasuko; Richmond, Barry J (2007) Cue and reward signals carried by monkey entorhinal cortex neurons during reward schedules. Exp Brain Res 181:267-76
Lerchner, Alexander; La Camera, Giancarlo; Richmond, Barry (2007) Knowing without doing. Nat Neurosci 10:15-7
Mizuhiki, Takashi; Richmond, Barry J; Shidara, Munetaka (2007) Mode changes in activity of single neurons in anterior insular cortex across trials during multi-trial reward schedules. Neurosci Res 57:587-91
Nakahara, Hiroyuki; Amari, Shun-ichi; Richmond, Barry J (2006) A comparison of descriptive models of a single spike train by information-geometric measure. Neural Comput 18:545-68

Showing the most recent 10 out of 25 publications