The brain uses experience with environmental events to construct a framework for integrating the information received from its different senses. The end result is enhanced sensitivity to those cross-modal stimulus configurations that are likely to be derived from the same event. This capacity for 'multisensory integration'optimizes the brain's sensitivity to events of biological significance, and its behavioral responses to those events. It is of obvious survival value. The neural and behavioral manifestations of this process have been studied most extensively in the midbrain superior colliculus (SC), a structure involved in detecting and orienting to external stimuli. However, it is not yet known whether or not once formed during early life, the fundamental spatial and temporal principles that govern multisensory integration are 'fixed'thereafter, or can continue to adapt to changing environmental conditions. Nor is it known whether higher- order cognitive processes can co-opt these midbrain processes so that arbitrary covariant cross-modal features can be accommodated. Based on preliminary observations, we propose that the adult brain retains its sensitivity to the statistics of cross-modal events and is subject to cognitive oversight. Thus, any changes in those cross-modal statistics, or their significance, result in changes in the governing principles of multisensory integration. The present proposal uses multiple approaches and preparations to test these hypotheses. Adult animals will be exposed to systematic alterations in cross-modal statistics and/or their 'significance'via their association with reward. Then, the resultant short-term and long-term neural and behavioral effects of these experiences will be examined. The experiments are also designed to examine where in the neural circuit underlying SC multisensory integration, these experiences are encoded.

Public Health Relevance

Anomalies in multisensory integration have been identified in a number of developmental disorders (e.g., Autism Spectrum Disorder, Dyslexia) and following various forms of traumatic and ischemic brain injury. Significant numbers of American families are negatively affected by these disorders, and while symptom-based multisensory rehabilitative strategies are now being used, our fundamental ignorance about the mechanisms of its inherent plasticity hampers innovation. Results of the proposed experiments will be of significant value in developing an empirical framework within which effective rehabilitative strategies can be developed.

National Institute of Health (NIH)
National Eye Institute (NEI)
Research Project (R01)
Project #
Application #
Study Section
Special Emphasis Panel (ZRG1)
Program Officer
Araj, Houmam H
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Wake Forest University Health Sciences
Anatomy/Cell Biology
Schools of Medicine
United States
Zip Code
Miller, Ryan L; Stein, Barry E; Rowland, Benjamin A (2017) Multisensory Integration Uses a Real-Time Unisensory-Multisensory Transform. J Neurosci 37:5183-5194
Xu, Jinghong; Yu, Liping; Rowland, Benjamin A et al. (2017) The normal environment delays the development of multisensory integration. Sci Rep 7:4772
Yu, Liping; Xu, Jinghong; Rowland, Benjamin A et al. (2016) Multisensory Plasticity in Superior Colliculus Neurons is Mediated by Association Cortex. Cereb Cortex 26:1130-7
Miller, Ryan L; Pluta, Scott R; Stein, Barry E et al. (2015) Relative unisensory strength and timing predict their multisensory product. J Neurosci 35:5213-20
Xu, Jinghong; Yu, Liping; Stanford, Terrence R et al. (2015) What does a neuron learn from multisensory experience? J Neurophysiol 113:883-9
Xu, Jinghong; Yu, Liping; Rowland, Benjamin A et al. (2014) Noise-rearing disrupts the maturation of multisensory integration. Eur J Neurosci 39:602-13
Stein, Barry E; Stanford, Terrence R; Rowland, Benjamin A (2014) Development of multisensory integration from the perspective of the individual neuron. Nat Rev Neurosci 15:520-35
Rowland, Benjamin A; Jiang, Wan; Stein, Barry E (2014) Brief cortical deactivation early in life has long-lasting effects on multisensory behavior. J Neurosci 34:7198-202
Rowland, Benjamin A; Stein, Barry E (2014) A model of the temporal dynamics of multisensory enhancement. Neurosci Biobehav Rev 41:78-84
Yu, Liping; Xu, Jinghong; Rowland, Benjamin A et al. (2013) Development of cortical influences on superior colliculus multisensory neurons: effects of dark-rearing. Eur J Neurosci 37:1594-601

Showing the most recent 10 out of 34 publications