Historically, research concerning children with mild to severe hearing loss (childHL) has been descriptive in nature, informing us about their abilities to recognize and produce spoken language. In the last grant cycle, we broke with tradition and pioneered a Multimodal Picture Word Task to study children's phonological processing. Results showed that childHL demonstrate a disproportionately large influence of visual speech during audiovisual (AV) speech processing when compared to children with normal hearing (childNH), and that childHL who have poorer articulation skills and slow responses demonstrate an unusual response to distracters that contain the schwa vowel. Although these distracters were designed to facilitate phonological processing, they produced an interference effect for this subset of children. An unexpected finding for both participant groups was a U-shape development function, where very young and older children were more sensitive to visual speech information than children of in between ages. In this grant cycle, our inter-university team of experts will implement a novel variant of the classic McGurk and Phoneme Restoration paradigms to account for the differences noted in AV speech processing between childHL and childNH. One hundred and seventy two participants between the ages of 4 and 14 years will complete a comprehensive battery of demographic tests and then be asked to perform the new McGurk-Phoneme Restoration-like tasks with stimuli that assess their sensitivity to AV speech (both meaningful and non-meaningful) and other tasks that assess speech and nonspeech processing for dynamic and static AV stimuli. Sixty of the children will also participate in a longitudinal study, repeating the test sessions for three consecutive years. The results will clarify issues about how hearing loss and normal maturation affect AV processing for various speech and nonspeech forms and the link that exists between childHL's speech perception and speech production abilities.

Public Health Relevance

Although about 6 out of every 1000 children in the United States have mild to severe hearing loss by the time they begin school, little is know about how hearing loss affects their abilities to process spoken language audiovisually, as in face-to-face communication interactions. The purpose of this research is to advance understanding of how childhood hearing loss affects audiovisual speech processing and to test the hypotheses that hearing status, age, and articulation proficiency interact with performance.

National Institute of Health (NIH)
National Institute on Deafness and Other Communication Disorders (NIDCD)
Research Project (R01)
Project #
Application #
Study Section
Language and Communication Study Section (LCOM)
Program Officer
Donahue, Amy
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of Texas-Dallas
Other Domestic Higher Education
United States
Zip Code
Jerger, Susan; Tye-Murray, Nancy; Damian, Markus F et al. (2013) Effect of hearing loss on semantic access by auditory and audiovisual speech in children. Ear Hear 34:753-62
Jerger, Susan; Damian, Markus F; Spence, Melanie J et al. (2009) Developmental shifts in children's sensitivity to visual speech: a new multimodal picture-word task. J Exp Child Psychol 102:40-59
Jerger, S; Grimes, A; Tran, T et al. (1997) Childhood hearing impairment: processing dependencies in multidimensional speech perception for an auditory level of analysis. Ear Hear 18:513-35
Lew, H; Chmiel, R; Jerger, J et al. (1997) Electrophysiologic indices of Stroop and Garner interference reveal linguistic influences on auditory and visual processing. J Am Acad Audiol 8:104-18