Although cross-modal plasticity as a result of sensory deprivation has been documented across a wide variety of brain areas for a wide range of tasks we still have very little idea how or why cross-modal develops as it does. It is generally supposed that, when deprived of normal input, brain areas continue to fulfill their functional role, but use input from other modalities. In support of this, it has been shown that MT+, a brain region highly selective for visual motion in normally sighted individuals, responds to auditory and tactile motion after early blindness. Similarly, primary auditory and surrounding cortex (PAC+), which are sensitive to apparent movement of synthesized sounds, can be activated by visual motion in profoundly deaf subjects. However, it is not clear whether these cross-modal responses carry any behavioral relevance, or whether such responses share common architecture with normal functions. The goal of this proposed project is to address these questions using a combination of BOLD multivoxel pattern analysis and adaptation techniques within both deaf and blind individuals.

Public Health Relevance

A better understanding of cross-modal plasticity has strong clinical relevance: while there have recently been practical advances in rehabilitation and skill-training after sensory loss, or cortical visual/auditory injury due to stroke or trauma, our abilit to develop better rehabilitation protocols is currently limited by our lack of scientific understandin of the cortical mechanisms that underlies this plasticity in humans. and their behavioral relevance. This work is likely to have significant clinical ramifications in that it will help in development of improved knowledge-driven rehabilitation procedures.

National Institute of Health (NIH)
National Eye Institute (NEI)
Career Transition Award (K99)
Project #
Application #
Study Section
Special Emphasis Panel (ZEY1-VSN (07))
Program Officer
Wiggs, Cheri
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of Washington
Schools of Arts and Sciences
United States
Zip Code
Gwinn, O Scott; Matera, Courtney N; O'Neil, Sean F et al. (2018) Asymmetric neural responses for facial expressions and anti-expressions. Neuropsychologia 119:405-416
Vercillo, Tiziana; Carrasco, Carlos; Jiang, Fang (2017) Age-Related Changes in Sensorimotor Temporal Binding. Front Hum Neurosci 11:500
Yoshimoto, Sanae; Garcia, Jesel; Jiang, Fang et al. (2017) Visual discomfort and flicker. Vision Res 138:18-28
Vercillo, Tiziana; Jiang, Fang (2017) Spatial modulation of motor-sensory recalibration in early deaf individuals. Neuropsychologia 102:39-44
Jiang, Fang; Stecker, G Christopher; Boynton, Geoffrey M et al. (2016) Early Blindness Results in Developmental Plasticity for Auditory Motion Processing within Auditory and Occipital Cortex. Front Hum Neurosci 10:324
Jiang, Fang; Beauchamp, Michael S; Fine, Ione (2015) Re-examining overlap between tactile and visual motion responses within hMT+ and STS. Neuroimage 119:187-96
Jiang, Fang; Stecker, G Christopher; Fine, Ione (2014) Auditory motion processing after early blindness. J Vis 14:4