The proposed project investigates the neural mechanisms underlying human reinforcement learning. Electrophysiological recordings from primates suggest that dopamine neurons encode a reward prediction error (RPE) signal required by reinforcement learning models. There is, however, scant evidence from humans supporting this conclusion. The proposed project uses a combination of clinical and neuroimaging approaches to study the neural correlates of age-related changes in reinforcement learning.
Our specific aims are as follows: 1) To determine to what extent the choice behavior of young and elderly subjects matches the predictions of animal reinforcement learning models in a task with a dynamic reinforcement schedule and to identify any age-related changes in reinforcement learning that might stem from normal age-related decline in the number of dopamine neurons. 2) To determine if reinforcement learning in elderly subjects that suffer from Parkinson's disease, an atypically severe reduction in the number of dopamine neurons, is affected by the disease and modulated by dopaminergic medication. This finding would provide causal evidence that dopamine underlies human reinforcement learning. 3) To determine if activity in dopamine areas measured by functional MRI is consistent with those areas encoding a RPE signal and to see if behavioral and neural estimates of reinforcement learning variables throughout the lifespan match consistently at all ages. We hope to find correlative and causal evidence for dopamine encoding the RPE signal in humans and hope to account for differences in reinforcement learning across the lifespan by changes in dopamine levels. ? ? ?

Agency
National Institute of Health (NIH)
Institute
National Institute on Aging (NIA)
Type
Predoctoral Individual National Research Service Award (F31)
Project #
1F31AG031656-01
Application #
7407852
Study Section
Special Emphasis Panel (ZRG1-F02A-A (20))
Program Officer
Wagster, Molly V
Project Start
2007-10-01
Project End
2010-09-30
Budget Start
2007-10-01
Budget End
2008-09-30
Support Year
1
Fiscal Year
2007
Total Cost
$35,347
Indirect Cost
Name
New York University
Department
Neurology
Type
Schools of Arts and Sciences
DUNS #
041968306
City
New York
State
NY
Country
United States
Zip Code
10012
Rutledge, Robb B; Dean, Mark; Caplin, Andrew et al. (2010) Testing the reward prediction error hypothesis with an axiomatic model. J Neurosci 30:13525-36
Rutledge, Robb B; Lazzaro, Stephanie C; Lau, Brian et al. (2009) Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. J Neurosci 29:15104-14