(provided by candidate): When rewards are expected only after some delay, their present value is reasonably determined by discounting their worth relative to the length of the delay. Experiments aimed at determining the nature of such time discount functions in people and animals have found that time is valued significantly more in the near-term than in the long-term: a phenomenon known as hyperbolic time discounting. The exact nature of hyperbolic discounting remains hotly debated, with no empirical data able to clearly distinguish between alternative hypotheses. In this proposal, a series of functional MRI experiments are developed to distinguish between two of the most popular theories for how hyperbolic discounting arises from brain function. We test several hypotheses as subjects make choices between rewarding outcomes of differing magnitudes at different delays. Our experiments employ both natural rewards (fruit juice) and monetary rewards to determine whether the associated brain structures generalize across reward modalities. In addition to this experimental work, we will conduct computational research using reinforcement learning methods to determine whether there are normative reasons for why people discount hyperbolically through time. ? ?
| D'Ardenne, Kimberlee; McClure, Samuel M; Nystrom, Leigh E et al. (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319:1264-7 |
| Bogacz, Rafal; McClure, Samuel M; Li, Jian et al. (2007) Short-term memory traces for action bias in human reinforcement learning. Brain Res 1153:111-21 |
| Cohen, Jonathan D; McClure, Samuel M; Yu, Angela J (2007) Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philos Trans R Soc Lond B Biol Sci 362:933-42 |
| McClure, Samuel M; Ericson, Keith M; Laibson, David I et al. (2007) Time discounting for primary rewards. J Neurosci 27:5796-804 |
