The broad objective of this proposal is to establish a quantitative algorithmic link between cellular and molecular events involved in reward processing and the behaviors that these events influence. In particular, we will focus on the nature and use of information that midbrain dopamine systems construct and distribute to neural structures throughout the brain. The activity of dopamine neurons of the ventral segmental area and substantia nigra has long been identified with the processing of rewarding stimuli. These neurons send axons to brain structures involved in motivation and goal directed behavior. These same dopamine systems are targets for disruption by disease and by drugs of abuse like heroine and cocaine. In alert primates, experiments show that the outputs of these neurons encode errors between the predictions of future rewards and actual times and magnitudes of future rewards. The prediction errors are apparently encoded as changes in the instantaneous spiking rates: values above baseline mean that the current state is 'better than predicted', values below mean that the current state is 'worse than predicted', and no difference means that 'things are as predicted'. We have developed a computational model of the behavior of midbrain dopamine neurons using a method of adaptive optimizing control called the method of temporal differences. The model is consistent with electrophysiological and behavioral data in monkeys, and also provably executes the appropriate computational function of determining which actions maximize long-term rewards. The long term goal of this project is to provide a computational connection between the action of dopaminergic mechanisms at the molecular and cellular level and the consequences of these mechanisms on behaviors observed in drug addiction. Three approaches will be used to accomplish this long term goal: (1) human behavioral experiments, (2) mathematical analysis, and (3) computer simulations of virtual creatures in complex environments. These three methods will focus on the function of dopaminergic systems in the primate and will be used to probe how normal mechanisms for making decisions in the face of rewards can be disrupted in addiction.

Agency
National Institute of Health (NIH)
Institute
National Institute on Drug Abuse (NIDA)
Type
Research Project (R01)
Project #
5R01DA011723-02
Application #
2898237
Study Section
Special Emphasis Panel (ZDA1-KXN-G (31))
Program Officer
Shurtleff, David
Project Start
1998-04-15
Project End
2001-03-31
Budget Start
1999-04-08
Budget End
2000-03-31
Support Year
2
Fiscal Year
1999
Total Cost
Indirect Cost
Name
Baylor College of Medicine
Department
Neurosciences
Type
Schools of Medicine
DUNS #
074615394
City
Houston
State
TX
Country
United States
Zip Code
77030
Hétu, Sébastien; Luo, Yi; D'Ardenne, Kimberlee et al. (2017) Human substantia nigra and ventral tegmental area involvement in computing social error signals during the ultimatum game. Soc Cogn Affect Neurosci 12:1972-1982
Hétu, Sébastien; Luo, Yi; Saez, Ignacio et al. (2016) Asymmetry in functional connectivity of the human habenula revealed by high-resolution cardiac-gated resting state imaging. Hum Brain Mapp 37:2602-15
Kirk, Ulrich; Gu, Xiaosi; Sharp, Carla et al. (2016) Mindfulness training increases cooperative decision making in economic exchanges: Evidence from fMRI. Neuroimage 138:274-283
Lu, James; Kishida, Ken; De Asis Cruz, Josepheen et al. (2015) Single stimulus fMRI produces a neural individual difference measure for Autism Spectrum Disorder. Clin Psychol Sci 3:422-432
Gu, Xiaosi; Lohrenz, Terry; Salas, Ramiro et al. (2015) Belief about nicotine selectively modulates value and reward prediction error signals in smokers. Proc Natl Acad Sci U S A 112:2539-44
Hula, Andreas; Montague, P Read; Dayan, Peter (2015) Monte Carlo Planning Method Estimates Planning Horizons during Interactive Social Exchange. PLoS Comput Biol 11:e1004254
Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan (2015) Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators. Soc Cogn Affect Neurosci 10:752-9
Kirk, Ulrich; Montague, P Read (2015) Mindfulness meditation modulates reward prediction errors in a passive conditioning task. Front Psychol 6:90
McAdams, Carrie J; Lohrenz, Terry; Montague, P Read (2015) Neural responses to kindness and malevolence differ in illness and recovery in women with anorexia nervosa. Hum Brain Mapp 36:5207-19
Kirk, Ulrich; Gu, Xiaosi; Harvey, Ann H et al. (2014) Mindfulness training modulates value signals in ventromedial prefrontal cortex through input from insular cortex. Neuroimage 100:254-62

Showing the most recent 10 out of 62 publications