How we see the world can be influenced strongly by our experiences. We can learn to associate certain visual images with impending rewards or punishments (e.g., seeing the front of a candy store). We can also learn to better differentiate weak, noisy, or obscure images with practice (e.g., an experienced bird- watcher identifying a bird in flight). The goal of our proposed research is to understand neural mechanisms common to these two seemingly different forms of visual learning, one that forms associations between visual input and reward-seeking behavior, the other that improves perceptual sensitivity. The key idea is that visual information is represented across heterogeneous populations of neurons in the brain, and both forms of learning involve a process of selecting neurons from these populations that have the appropriate characteristics for a given task. Associative learning requires selecting neurons that represent the appropriate visual features that predict reward. Perceptual learning requires selecting neurons that represent a particular visual feature with the highest sensitivity. Our three specific Aims will use computational modeling, human psychophysics, and combined psychophysics and physiology in monkeys to identify neural mechanisms that govern this selection process.
Aim 1 will introduce a computational model that can account for both associative and perceptual learning by selecting outputs from a sensory representation based on their ability to guide behavior that maximizes reward. We will test the model in several ways, including a comparison to behavioral and neural data from monkeys learning a demanding visual discrimination task and behavioral data from human subjects learning a similar task. The model is based on two computational principles that will guide the experiments in the other two Aims. The first principle is that learning results from changes in functional connectivity between sensory and decision neurons.
Aim 2 will test whether changes in interactions between two cortical areas reflect these predicted changes in functional connectivity. The second principle is that learning is driven by a process that identifies discrepancies between predicted and actual reward.
Aim 3 will test whether neurons in a subcortical structure known as the caudate encode this kind of reward prediction error during learning. These studies will help to unify previously disparate fields of associative and perceptual learning and provide a far-reaching perspective on mechanisms that allow experiences to shape the functions of a healthy visual system.

Public Health Relevance

The proposed work is basic research, designed to provide new insights into how a healthy nervous system learns from experience to more effectively process visual information. Thus, direct benefits to public health are intended to come in the longer term, as these new insights can be used to design new ways to diagnose and treat disorders of visual perception (i.e., visual agnosias) and learning.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
5R01EY015260-09
Application #
8420493
Study Section
Central Visual Processing Study Section (CVP)
Program Officer
Steinmetz, Michael A
Project Start
2003-12-01
Project End
2015-01-31
Budget Start
2013-02-01
Budget End
2014-01-31
Support Year
9
Fiscal Year
2013
Total Cost
$359,317
Indirect Cost
$131,317
Name
University of Pennsylvania
Department
Neurosciences
Type
Schools of Medicine
DUNS #
042250712
City
Philadelphia
State
PA
Country
United States
Zip Code
19104
Kalwani, Rishi M; Joshi, Siddhartha; Gold, Joshua I (2014) Phasic activation of individual neurons in the locus ceruleus/subceruleus complex of monkeys reflects rewarded decisions to go but not stop. J Neurosci 34:13656-69
Ding, Long; Gold, Joshua I (2013) The basal ganglia's contributions to perceptual decision making. Neuron 79:640-9
Nassar, Matthew R; Gold, Joshua I (2013) A healthy fear of the unknown: perspectives on the interpretation of parameter fits from computational models in neuroscience. PLoS Comput Biol 9:e1003015
Wilson, Robert C; Nassar, Matthew R; Gold, Joshua I (2013) A mixture of delta-rules approximation to bayesian inference in change-point problems. PLoS Comput Biol 9:e1003150
Bennur, Sharath; Gold, Joshua I (2011) Distinct representations of a perceptual decision and the associated oculomotor plan in the monkey lateral intraparietal area. J Neurosci 31:913-21
Nassar, Matthew R; Wilson, Robert C; Heasly, Benjamin et al. (2010) An approximately Bayesian delta-rule model explains the dynamics of belief updating in a changing environment. J Neurosci 30:12366-78
Gold, Joshua I; Law, Chi-Tat; Connolly, Patrick et al. (2010) Relationships between the threshold and slope of psychometric and neurometric functions during perceptual learning: implications for neuronal pooling. J Neurophysiol 103:140-54
Kalwani, Rishi M; Bloy, Luke; Elliott, Mark A et al. (2009) A method for localizing microelectrode trajectories in the macaque brain using MRI. J Neurosci Methods 176:104-11
Law, Chi-Tat; Gold, Joshua I (2009) Reinforcement learning can account for associative and perceptual learning on a visual-decision task. Nat Neurosci 12:655-63
Connolly, Patrick M; Bennur, Sharath; Gold, Joshua I (2009) Correlates of perceptual learning in an oculomotor decision variable. J Neurosci 29:2136-50

Showing the most recent 10 out of 13 publications