The anatomical substrates and cellular mechanisms underlying reward-dependent learning have been studied for decades, but the specific circuit and network interactions between the cortex, striatum, and midbrain that mediate action selection have not been systematically investigated. Here, we bring together three different investigators with specialized expertise in each of these three brain regions. As a team, the investigators are well positioned to perform cutting-edge cell-type-, region-, and projection-specific imaging and ontogenetic manipulations of neuronal ensembles during complex behavioral tasks designed to uncover the network-level representation of decision-related variables for action selection. The computational frameworks for analyzing these data are provided by reinforcement learning models.
In Aim 1, the focus is on the striatum, which arguably lies at the center of reward-dependent learning. It is the point of intersection for sensorimotor and contextual information from cortex, and reward- and motivation-related information from the midbrain. Using microendoscopy with calcium imaging from genetically-specified neuronal subtypes in different striatal subregions during behavior, we will identify the key decision-related variables represented in the striatum during action selection tasks.
In Aim 2, we will image from specific populations of dopamine neurons in the midbrain that project to different striatal subregions, in order to decipher their role in reward-related signaling.
In Aim , we will image large ensembles of neurons in the motor cortex (M1 and M2) using two-photon microscopy, with a focus on neurons projecting to distinct cell types and subregions of striatum. All three aims will use the same behavioral tasks, and the same analysis techniques, in order to facilitate the integration of data from all three brain regions into a single coherent model for vertebrate action selection.

Public Health Relevance

Understanding the neural processes for action selection is of fundamental importance to developing therapies for both neurological and psychiatric disease. However, large-scale imaging of specific cell types within the networks that control action selection has not been performed. Here, we bring together multiple investigators with expertise in viral methods for circuit tracing, ensemble imaging of neuronal networks in vivo, computational methods, and behavioral analysis to gain unprecedented insight into the processes underlying reward-dependent learning and action selection.

Agency
National Institute of Health (NIH)
Institute
National Institute of Neurological Disorders and Stroke (NINDS)
Type
Research Project--Cooperative Agreements (U01)
Project #
5U01NS094342-02
Application #
9146717
Study Section
Special Emphasis Panel (ZNS1)
Program Officer
Gnadt, James W
Project Start
2015-09-30
Project End
2018-08-31
Budget Start
2016-09-01
Budget End
2017-08-31
Support Year
2
Fiscal Year
2016
Total Cost
Indirect Cost
Name
J. David Gladstone Institutes
Department
Type
DUNS #
099992430
City
San Francisco
State
CA
Country
United States
Zip Code
94158
Li, Wankun L; Chu, Monica W; Wu, An et al. (2018) Adult-born neurons facilitate olfactory bulb pattern separation during task engagement. Elife 7:
Mitani, Akinori; Dong, Mingyuan; Komiyama, Takaki (2018) Brain-Computer Interface with Inhibitory Neurons Reveals Subtype-Specific Strategies. Curr Biol 28:77-83.e4
Peters, Andrew J; Liu, Haixin; Komiyama, Takaki (2017) Learning in the Rodent Motor Cortex. Annu Rev Neurosci 40:77-97
Chu, Monica W; Li, Wankun L; Komiyama, Takaki (2017) Lack of Pattern Separation in Sensory Inputs to the Olfactory Bulb during Perceptual Learning. eNeuro 4:
Hwang, Eun Jung; Dahlen, Jeffrey E; Mukundan, Madan et al. (2017) History-based action selection bias in posterior parietal cortex. Nat Commun 8:1242
Peters, Andrew J; Lee, Jun; Hedrick, Nathan G et al. (2017) Reorganization of corticospinal output during motor learning. Nat Neurosci 20:1133-1141
Makino, Hiroshi; Ren, Chi; Liu, Haixin et al. (2017) Transformation of Cortex-wide Emergent Properties during Motor Learning. Neuron 94:880-890.e8
Makino, Hiroshi; Hwang, Eun Jung; Hedrick, Nathan G et al. (2016) Circuit Mechanisms of Sensorimotor Learning. Neuron 92:705-721
Chu, Monica W; Li, Wankun L; Komiyama, Takaki (2016) Balancing the Robustness and Efficiency of Odor Representations during Learning. Neuron 92:174-186