Historically, research concerning children with mild to severe hearing loss (childHL) has been descriptive in nature, informing us about their abilities to recognize and produce spoken language. In the last grant cycle, we broke with tradition and pioneered a Multimodal Picture Word Task to study children's phonological processing. Results showed that childHL demonstrate a disproportionately large influence of visual speech during audiovisual (AV) speech processing when compared to children with normal hearing (childNH), and that childHL who have poorer articulation skills and slow responses demonstrate an unusual response to distracters that contain the schwa vowel. Although these distracters were designed to facilitate phonological processing, they produced an interference effect for this subset of children. An unexpected finding for both participant groups was a U-shape development function, where very young and older children were more sensitive to visual speech information than children of in between ages. In this grant cycle, our inter-university team of experts will implement a novel variant of the classic McGurk and Phoneme Restoration paradigms to account for the differences noted in AV speech processing between childHL and childNH. One hundred and seventy two participants between the ages of 4 and 14 years will complete a comprehensive battery of demographic tests and then be asked to perform the new McGurk-Phoneme Restoration-like tasks with stimuli that assess their sensitivity to AV speech (both meaningful and non-meaningful) and other tasks that assess speech and nonspeech processing for dynamic and static AV stimuli. Sixty of the children will also participate in a longitudinal study, repeating the test sessions for three consecutive years. The results will clarify issues about how hearing loss and normal maturation affect AV processing for various speech and nonspeech forms and the link that exists between childHL's speech perception and speech production abilities.

Public Health Relevance

Although about 6 out of every 1000 children in the United States have mild to severe hearing loss by the time they begin school, little is known about how hearing loss affects their abilities to process spoken language audiovisually, as in face-to-face communication interactions. The purpose of this research is to advance understanding of how childhood hearing loss affects audiovisual speech processing and to test the hypotheses that hearing status, age, and articulation proficiency interact with performance.

National Institute of Health (NIH)
National Institute on Deafness and Other Communication Disorders (NIDCD)
Research Project (R01)
Project #
Application #
Study Section
Language and Communication Study Section (LCOM)
Program Officer
Sklare, Dan
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of Texas-Dallas
Other Domestic Higher Education
United States
Zip Code
Jerger, Susan; Damian, Markus F; McAlpine, Rachel P et al. (2018) Visual speech fills in both discrimination and identification of non-intact auditory speech in children. J Child Lang 45:392-414
Jerger, Susan; Damian, Markus F; McAlpine, Rachel P et al. (2017) Visual speech alters the discrimination and identification of non-intact auditory speech in children with hearing loss. Int J Pediatr Otorhinolaryngol 94:127-137
Jerger, Susan; Damian, Markus F; Tye-Murray, Nancy et al. (2017) Children perceive speech onsets by ear and eye. J Child Lang 44:185-215
Jerger, Susan; Tye-Murray, Nancy; Damian, Markus F et al. (2016) Phonological Priming in Children with Hearing Loss: Effect of Speech Mode, Fidelity, and Lexical Status. Ear Hear 37:623-633
Jerger, Susan; Damian, Markus F; Tye-Murray, Nancy et al. (2014) Children use visual speech to compensate for non-intact auditory speech. J Exp Child Psychol 126:295-312
Jerger, Susan; Damian, Markus F; Mills, Candice et al. (2013) Effect of perceptual load on semantic access by speech in children. J Speech Lang Hear Res 56:388-403
Jerger, Susan; Tye-Murray, Nancy; Damian, Markus F et al. (2013) Effect of hearing loss on semantic access by auditory and audiovisual speech in children. Ear Hear 34:753-62
Jerger, Susan; Tye-Murray, Nancy; Abdi, Hervé (2009) Role of visual speech in phonological processing by children with hearing loss. J Speech Lang Hear Res 52:412-34
Jerger, Susan; Damian, Markus F; Spence, Melanie J et al. (2009) Developmental shifts in children's sensitivity to visual speech: a new multimodal picture-word task. J Exp Child Psychol 102:40-59
Mehta, Jyutika; Jerger, Susan; Jerger, James et al. (2009) Electrophysiological correlates of word comprehension: event-related potential (ERP) and independent component analysis (ICA). Int J Audiol 48:1-11

Showing the most recent 10 out of 12 publications