This is a resubmission of a research proposal to uncover the basis of timing estimation in the brain based on recent experimental and theoretical advances. This is a combined experimental and computational proposal. A fundamental task accomplished by the brain is the formation of adaptive behaviors generated in response to learned contingencies between environmental stimuli. Yet, the neural process by which we learn the behavioral relevance of environmental cues, specifically visual cues, and the mechanism by which brains generate temporal expectancies based on such visual evidence, is unknown. Exemplifying this process and motivating the work proposed here is the unexpected finding by Shuler and Bear[1] that pairing visual stimuli with delayed reward leads to the emergence of reward-timing activity in the primary visual cortex (V1). This finding suggests that V1 does not act simply as a passive filter bank surveying the visual world, but instead contains complex internal programs that signal the behavioral relevance of visual events, and participates in computing the animals'behavioral response. Based on these recent findings, we developed a network-based theory of timing computation in cortex. This theory can account both for how times are computed and how they are learned. In this proposal we develop and test this model for understanding this issue, proffering a series of experimentally tractable predictions that test a radical notion: Learning visually-cued expectancies occurs locally within the primary visual cortex (V1) as a result of an interaction between an impinging reinforcement signal conveying the outcome of behavior with prior synaptic activity. We will test using optogenetic techniques, the identity and nature of the reward signal in V1, and consequently also test if the computation is local to V1. Using a combination of behavioral electrophysiology and computational techniques we will establish if there is a relationship between the observed dynamics in V1 and behavior and manipulate that relationship ontogenetically, and also account for the experimentally observed scalar property in time perception on the basis of the observed physiology and the computational model, all hallmarks of our model. The neural mechanism by which V1 - and more broadly, cortex - comes to express cue-reward intervals is unknown and is addressed in this study. Consequently, the results of this study will bear greatly on neural processes of memory and learning, forming a basis of understanding for cognitive dysfunction.

Public Health Relevance

The proposal will address the neural mechanism by which the brain can learn the behavioral significance of environmental cues, specifically visual cues, and generate neural and behavioral temporal expectancies based on such visual evidence. These discoveries will provide new insight into our current understanding of reinforcement learning. Consequently, the results of this study will bear greatly on neural processes of memory, learning, and reward, forming a basis of understanding for cognitive dysfunction.

Agency
National Institute of Health (NIH)
Institute
National Institute of Mental Health (NIMH)
Type
Research Project (R01)
Project #
5R01MH093665-02
Application #
8442298
Study Section
Cognitive Neuroscience Study Section (COG)
Program Officer
Osborn, Bettina D
Project Start
2012-03-10
Project End
2014-12-31
Budget Start
2013-01-01
Budget End
2013-12-31
Support Year
2
Fiscal Year
2013
Total Cost
$377,654
Indirect Cost
$79,698
Name
Johns Hopkins University
Department
Neurosciences
Type
Schools of Medicine
DUNS #
001910777
City
Baltimore
State
MD
Country
United States
Zip Code
21218
Levy, Joshua M; Zold, Camila L; Namboodiri, Vijay Mohan K et al. (2017) The Timing of Reward-Seeking Action Tracks Visually Cued Theta Oscillations in Primary Visual Cortex. J Neurosci 37:10408-10420
Namboodiri, Vijay Mk; Hussain Shuler, Marshall G (2016) The hunt for the perfect discounting function and a reckoning of time perception. Curr Opin Neurobiol 40:135-141
Namboodiri, Vijay Mohan K; Mihalas, Stefan; Hussain Shuler, Marshall G (2016) Analytical Calculation of Errors in Time and Value Perception Due to a Subjective Time Accumulator: A Mechanistic Model and the Generation of Weber's Law. Neural Comput 28:89-117
Shuler, Marshall G Hussain (2016) Timing in the visual cortex and its investigation. Curr Opin Behav Sci 8:73-77
Namboodiri, Vijay Mohan K; Levy, Joshua M; Mihalas, Stefan et al. (2016) Rationalizing spatial exploration patterns of wild animals and humans through a temporal discounting framework. Proc Natl Acad Sci U S A 113:8747-52
Lin, Shih-Chieh; Brown, Ritchie E; Hussain Shuler, Marshall G et al. (2015) Optogenetic Dissection of the Basal Forebrain Neuromodulatory Control of Cortical Activation, Plasticity, and Cognition. J Neurosci 35:13896-903
He, Kaiwen; Huertas, Marco; Hong, Su Z et al. (2015) Distinct Eligibility Traces for LTP and LTD in Cortical Synapses. Neuron 88:528-38
Huertas, Marco A; Hussain Shuler, Marshall G; Shouval, Harel Z (2015) A Simple Network Architecture Accounts for Diverse Reward Time Responses in Primary Visual Cortex. J Neurosci 35:12659-72
Liu, Cheng-Hang; Coleman, Jason E; Davoudi, Heydar et al. (2015) Selective activation of a putative reinforcement signal conditions cued interval timing in primary visual cortex. Curr Biol 25:1551-61
Namboodiri, Vijay Mohan K; Huertas, Marco A; Monk, Kevin J et al. (2015) Visually cued action timing in the primary visual cortex. Neuron 86:319-30

Showing the most recent 10 out of 16 publications