Understanding speech is a remarkable ability: listeners need to extract asynchronously distributed phonological features from a transient and noisy signal that unfolds at speeds not under their control. Despite the ubiquitous success of spoken language processing among the general population, 5% of first graders enter school with some type of speech sound disorder that cannot be accounted for by hearing impairment. In addition, once the language system has been successfully acquired, it is susceptible to insult from injury or stroke (accounting for 1 million adults in the U.S. with some form of aphasia). One of the biggest challenges that speech understanding has to overcome is that speakers differ in how exactly they realize the same intended sound, so that one speaker's 'peach' might by physically indistinguishable from another speaker's 'beach'. Research suggests that we overcome this challenge by rapidly adapting to speaker-specific pronunciations. A more complete understanding of the perceptual and computational capacities underlying these adaptation processes is essential to advancing understanding of both normal and deviant language acquisition and processing.
The aim of the proposed project is to develop and test an explicit computational model of the cognitive processes that underlie our ability to rapidly adjust to speaker-specific pronunciations ('accents'). To this end, we investigate how listeners integrate information about speakers' accents while listening to their speech. We propose that listeners weigh previous experience with other speakers against the percepts received from the current speaker. We investigate adaptation to a single speaker, adaptation to multiple speakers, and generalization from previously encountered speakers to novel speakers. The computational framework we pursue, also predicts that alternative reasons for unexpected pronunciations (such as chewing on a piece of gum), if present, can block adaptation effects. We investigate and model such 'explaining away' of unusual pronunciations. To collect large amounts of adaptation data in a fraction of the time previously required for experiments on speech perception, we have developed a web-based experimental interface that allows us to reach hundreds of thousands of participants.

Public Health Relevance

While understand speech seemingly effortlessly, this ability involves continuous learning and adaptation to speaker-specific pronunciations. A more complete understanding of the perceptual and computational capacities underlying these adaptation processes is essential to advancing understanding of both normal and deviant language acquisition, development throughout childhood, and language understanding in adults.

Agency
National Institute of Health (NIH)
Institute
Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD)
Type
Research Project (R01)
Project #
4R01HD075797-04
Application #
9034645
Study Section
Language and Communication Study Section (LCOM)
Program Officer
Alvarez, Ruben P
Project Start
2013-07-05
Project End
2018-03-31
Budget Start
2016-04-01
Budget End
2017-03-31
Support Year
4
Fiscal Year
2016
Total Cost
Indirect Cost
Name
University of Rochester
Department
Other Basic Sciences
Type
Schools of Arts and Sciences
DUNS #
041294109
City
Rochester
State
NY
Country
United States
Zip Code
14627
Kleinschmidt, Dave F; Weatherholtz, Kodi; Florian Jaeger, T (2018) Sociolinguistic Perception as Inference Under Uncertainty. Top Cogn Sci 10:818-834
Kuperberg, Gina R; Jaeger, T Florian (2016) What do we mean by prediction in language comprehension? Lang Cogn Neurosci 31:32-59
Qian, Ting; Jaeger, T Florian; Aslin, Richard N (2016) Incremental implicit learning of bundles of statistical patterns. Cognition 157:156-173
Jaeger, T Florian; Weatherholtz, Kodi (2016) What the Heck Is Salience? How Predictive Language Processing Contributes to Sociolinguistic Perception. Front Psychol 7:1115
Fraundorf, Scott H; Jaeger, T Florian (2016) Readers generalize adaptation to newly-encountered dialectal structures to other unfamiliar structures. J Mem Lang 91:28-58
Pajak, Bozena; Fine, Alex B; Kleinschmidt, Dave F et al. (2016) Learning Additional Languages as Hierarchical Probabilistic Inference: Insights From First Language Processing. Lang Learn 66:900-944
Kleinschmidt, Dave F; Jaeger, T Florian (2016) Re-examining selective adaptation: Fatiguing feature detectors, or distributional learning? Psychon Bull Rev 23:678-91
Yildirim, Ilker; Degen, Judith; Tanenhaus, Michael K et al. (2016) Talker-specificity and adaptation in quantifier interpretation. J Mem Lang 87:128-143
Kleinschmidt, Dave F; Jaeger, T Florian (2015) Robust speech perception: recognize the familiar, generalize to the similar, and adapt to the novel. Psychol Rev 122:148-203
Jaeger, T Florian; Ferreira, Victor (2013) Seeking predictions from a predictive framework. Behav Brain Sci 36:359-60

Showing the most recent 10 out of 11 publications