Although several popular theories postulate that the capacity to engage in multisensory integration is already present at birth, and is largely insensitive to experience, observations from the past grant period suggest quite the opposite. Using midbrain and cortical multisensory neurons as models, we found that this capacity develops only gradually during postnatal life and requires sensory experience for the maturation of its underlying neural circuit. Indeed, the superior colliculus (SC) model from which most of the data were collected also showed that the nature of early cross-modal experiences drive the development of this capacity and determine its form in adulthood. Using this model, the present proposal will identify the fundamental epigenetic principles that guide the postnatal development and elaboration of multisensory integration (i.e., the developmental foundations for solving the multisensory """"""""binding problem""""""""). Our hypothesis is that the solution lies in the brain's use of a statistical approach by which general operational principles are extracted from the host of early life experiences with cross-modal events to govern how neurons synthesize information from different senses and effect overt behavior. In this way, multisensory integration is crafted to function optimally in the specific environment in which it will be used. Its dependence on the covariance statistics of cross-modal stimuli establishes the maturation of multisensory integration as fundamentally different from that of its modality-specific counterparts;not only in its experiential requirements and the strategies used to encode this information, but also in its maturational time course. This is evident even in the same neurons, as multisensory neurons process both unisensory and multisensory information. Furthermore, we hypothesize, that in the case of multisensory integration, the instantiation of this guiding experience is via the cortico-SC circuit, which is the substrate on which different cross-modal experiences are superimposed, competing for representation based on their statistical likelihoods. And finally, although we believe that the effects of experience on integrative strategies to be greatest during early life when the brain is most plastic, the preset proposal will also address the possibility that these strategies can also be utilized later in life given the appropriate circumstances.

Public Health Relevance

Although the approaches used here target fundamental neural features of multisensory integration, the theoretical framework bears directly on issues relevant to a host of maturational dysfunctions in sensory processing, including those manifested in ADHD, dyslexia, autism, and several trauma-induced developmental disorders. For example, it is quite possible that the various components of multisensory integration (i.e., latency shifts, changes in response magnitude, or changes in the information rate) have different developmental time courses, sensitivity to experience and utility at different life stages. If so, there will likely be considerable differences in the consequences of interrupting their elaboration at any of those stages. This information holds promise not only for explaining some of the striking variations in the dysfunction profiles of patients with early sensory processing disorders, but also for insights into their etiology and rehabilitative strategies for dealing with these anomalies. Such information will also be of more than passing interest to patients born with visual and/or auditory deficits that are later corrected via drug therapy or prosthetic devices, and who may have to integrate some cross-modal inputs for the first time.

National Institute of Health (NIH)
National Institute of Neurological Disorders and Stroke (NINDS)
Research Project (R01)
Project #
Application #
Study Section
Cognitive Neuroscience Study Section (COG)
Program Officer
Gnadt, James W
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Wake Forest University Health Sciences
Anatomy/Cell Biology
Schools of Medicine
United States
Zip Code
Yu, Liping; Xu, Jinghong; Rowland, Benjamin A et al. (2016) Multisensory Plasticity in Superior Colliculus Neurons is Mediated by Association Cortex. Cereb Cortex 26:1130-7
Miller, Ryan L; Pluta, Scott R; Stein, Barry E et al. (2015) Relative unisensory strength and timing predict their multisensory product. J Neurosci 35:5213-20
Xu, Jinghong; Yu, Liping; Stanford, Terrence R et al. (2015) What does a neuron learn from multisensory experience? J Neurophysiol 113:883-9
Rowland, Benjamin A; Stein, Barry E (2014) A model of the temporal dynamics of multisensory enhancement. Neurosci Biobehav Rev 41:78-84
Xu, Jinghong; Yu, Liping; Rowland, Benjamin A et al. (2014) Noise-rearing disrupts the maturation of multisensory integration. Eur J Neurosci 39:602-13
Stein, Barry E; Stanford, Terrence R; Rowland, Benjamin A (2014) Development of multisensory integration from the perspective of the individual neuron. Nat Rev Neurosci 15:520-35
Rowland, Benjamin A; Jiang, Wan; Stein, Barry E (2014) Brief cortical deactivation early in life has long-lasting effects on multisensory behavior. J Neurosci 34:7198-202
Yu, Liping; Xu, Jinghong; Rowland, Benjamin A et al. (2013) Development of cortical influences on superior colliculus multisensory neurons: effects of dark-rearing. Eur J Neurosci 37:1594-601
Yu, Liping; Rowland, Benjamin A; Xu, Jinghong et al. (2013) Multisensory plasticity in adulthood: cross-modal experience enhances neuronal excitability and exposes silent inputs. J Neurophysiol 109:464-74
Xu, Jinghong; Yu, Liping; Rowland, Benjamin A et al. (2012) Incorporating cross-modal statistics in the development and maintenance of multisensory integration. J Neurosci 32:2287-98

Showing the most recent 10 out of 64 publications