The broad, long-term objective of the proposed work is to understand the neural substrates of cortical multisensory processing, for it is these circuits that undoubtedly play an integral role in binding information from the different senses into a coherent perceptual whole. The emphasis of the previous grant period has been on detailing the development of multisensory cortical circuits and their plastic potential during early postnatal life, and we will continue to expand on this theme in the current work. In addition, we will focus on characterizing the functional circuitry that forms the basis for cortical multisensory processes, an essential yet unrealized step toward a better understanding of how our perceptual gestalt is created. The work will continue in the cat model, in which a substantial foundation of knowledge exists, facilitating the completion of the proposed studies. The work is divided into three specific aims. In the first, a combined anatomical and physiological approach will be employed in an effort to detail the functional architecture of cortical multisensory circuits. This work will represent the first systematic attempt to describe how multisensory networks in the cerebral cortex are assembled. In the second aim, the fine spatial architecture of cortical multisensory receptive fields will be detailed, and the hypothesis that receptive field structure and heterogeneity plays a critical deterministic role in multisensory interactions will be tested. These studies will be done in the awake and behaving animal in an effort to better understand the functional role of multisensory cortex. These experiments will seek to identify and describe a previously unrecognized level of complexity and flexibility to multisensory processes. In the final aim, the capacity of the adult brain for multisensory plasticity will be examined. Although it is clear from psychophysical studies that such capacity exists, virtually nothing is known about the neural substrates that likely form the basis for these changes. The ultimate goal of this work dovetails well with the mission of the National Institute of Mental Health (through whom this work has been previously funded), in that it seeks to further our basic science understanding of the brain bases of multisensory-mediated behavior and perception, with the ultimate goal of translating this knowledge into useful clinical strategies and interventions. In this regard, it is becoming increasingly clear that a number of clinical neurologic disorders with a sensory component (e.g., attention deficit hyperactivity disorder, autism spectrum disorder, developmental dyslexia) may have preferential deficits in multisensory processing, and that both diagnostic and remediation strategies founded on a multisensory platform may provide more effective outcomes for individuals suffering with these conditions.

Public Health Relevance

The proposed work has great relevance in both the basic science and clinical arenas. An improved understanding of multisensory cortical processing is an essential step toward a more complete understanding of the brain bases of behavior and perception. Such knowledge will be of tremendous utility in the public health arena, in that it can be applied toward the development of more sensitive diagnostic tools, as well as more effective remediation strategies, in the fight against brain disorders such as autism and dyslexia in which sensory and multisensory processes are preferentially compromised.

National Institute of Health (NIH)
National Institute of Mental Health (NIMH)
Research Project (R01)
Project #
Application #
Study Section
Cognitive Neuroscience Study Section (COG)
Program Officer
Rossi, Andrew
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Vanderbilt University Medical Center
Schools of Medicine
United States
Zip Code
Ghose, Dipanwita; Maier, Alexander; Nidiffer, Aaron et al. (2014) Multisensory response modulation in the superficial layers of the superior colliculus. J Neurosci 34:4332-44
Ghose, D; Wallace, M T (2014) Heterogeneity in the spatial receptive field architecture of multisensory neurons of the superior colliculus and its effects on multisensory integration. Neuroscience 256:147-62
Stevenson, Ryan A; Fister, Juliane Krueger; Barnett, Zachary P et al. (2012) Interactions between the spatial and temporal stimulus factors that influence multisensory integration in human performance. Exp Brain Res 219:121-37
Stevenson, Ryan A; Bushmakin, Maxim; Kim, Sunah et al. (2012) Inverse effectiveness and multisensory interactions in visual event-related potentials with audiovisual speech. Brain Topogr 25:308-26
Stevenson, Ryan A; Zemtsov, Raquel K; Wallace, Mark T (2012) Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions. J Exp Psychol Hum Percept Perform 38:1517-29
Royal, David W; Krueger, Juliane; Fister, Matthew C et al. (2010) Adult plasticity of spatiotemporal receptive fields of multisensory superior colliculus neurons following early visual deprivation. Restor Neurol Neurosci 28:259-70
Krueger, Juliane; Royal, David W; Fister, Matthew C et al. (2009) Spatial receptive field organization of multisensory neurons and its impact on multisensory interactions. Hear Res 258:47-54
Royal, David W; Carriere, Brian N; Wallace, Mark T (2009) Spatiotemporal architecture of cortical receptive fields and its impact on multisensory interactions. Exp Brain Res 198:127-36
Polley, Daniel B; Hillock, Andrea R; Spankovich, Christopher et al. (2008) Development and plasticity of intra- and intersensory information processing. J Am Acad Audiol 19:780-98
Carriere, Brian N; Royal, David W; Wallace, Mark T (2008) Spatial heterogeneity of cortical receptive fields and its impact on multisensory interactions. J Neurophysiol 99:2357-68

Showing the most recent 10 out of 22 publications