The goals of this research program are to investigate behavioral and neural consequences of lifelong sensory deprivation and relate those consequences to the potential to induce normal function in neural circuits following implantation of a sensory prosthesis. The fundamental hypotheses guiding the research plan are that: Lifelong sensorineural hearing impairment exerts profound multisensory effects on brain organization and function. Thus, the outcome of receiving a cochlear implant to induce hearing in adulthood will depend on multisensory cortical plasticity and processing. Prelingually deaf adults who are cochlear implant patients at the House Clinic will be enrolled in experiments that use behavioral, electrophysiological and functional magnetic resonance imaging (fMRI) methods to investigate multisensory (visual, vibrotactile, and auditory) processing before and after cochlear implantation. Speech and non-speech multisensory perceptual effects will be investigated. Controls will be normal-hearing adults. Experiments will investigate (1) audiovisual speech perception using behavioral methods at pre- and post-cochlear implantation;(2) Cortical activity in response to vibrotactile, visual, and visual-tactile speech stimuli, using fMRI before implantation;(3) Audiovisual versus auditory-only spoken word learning following implantation, using a behavioral training paradigm;(4) Multisensory audiovisual and visual-tactile stimulus detection before and after cochlear implantation, using event-related potentials (ERPs) from electroencephalographic (EEG) data;and (5) Multisensory event perception before and after cochlear implantation using behavioral, fMRI, and ERP data. Modeling methods for ERP data with constraints from anatomical and functional MRI will be used in order to achieve high spatial and temporal resolution data on cortical activity, and also to overcome limitations on the use of MRI following cochlear implantation. Comprehensive subject and device data will be obtained from patients to be used in conjunction with statistical analyses on experimental data and also to create a normative database on this clinical population. Relevance to Public Health: This project addresses fundamental questions about neural plasticity in adults. It explicitly tests a multisensory approach to sensory training that could generalize to other sensory disorders such as blindness. The project integrates basic science with ongoing clinical practice and with graduate student training.
| Tjan, Bosco S; Chao, Ewen; Bernstein, Lynne E (2014) A visual or tactile signal makes auditory speech detection more efficient by reducing uncertainty. Eur J Neurosci 39:1323-31 |
| Jiang, Jintao; Bernstein, Lynne E (2011) Psychophysics of the McGurk and other audiovisual speech integration effects. J Exp Psychol Hum Percept Perform 37:1193-209 |
| Joshi, Anand A; Pantazis, Dimitrios; Li, Quanzheng et al. (2010) Sulcal set optimization for cortical surface registration. Neuroimage 50:950-9 |
| Ponton, Curtis W; Bernstein, Lynne E; Auer Jr, Edward T (2009) Mismatch negativity with visual-only and audiovisual speech. Brain Topogr 21:207-15 |
| Bernstein, Lynne E; Lu, Zhong-Lin; Jiang, Jintao (2008) Quantified acoustic-optical speech signal incongruity identifies cortical sites of audiovisual speech processing. Brain Res 1242:172-84 |
| Bernstein, Lynne E; Auer Jr, Edward T; Wagner, Michael et al. (2008) Spatiotemporal dynamics of audiovisual speech processing. Neuroimage 39:423-35 |
| Auer Jr, Edward T; Bernstein, Lynne E; Sungkarat, Witaya et al. (2007) Vibrotactile activation of the auditory cortices in deaf versus hearing adults. Neuroreport 18:645-8 |
