This project addresses ways in which speakers use the vocal tract to create speech (production) and listeners extract the underlying meaningful parts of the signal (perception). Speech is an essential part of human society, and great effort is put into learning to talk, speaking with others, and repairing difficulties in speech when necessary. Speech is also quite variable, and the variability is due to both structured and random factors. The structured variability provides information about, for example, the size of the speaker?s vocal tract, where the speaker comes from, and what speech segments are adjacent to the one being produced. The random variability is often seen as unhelpful, but recent work indicates that it can provide flexibility that is beneficial. In the current proposal, measurements of speech articulation and acoustics will be combined with mathematical modeling to distinguish flexibility from diminished control. Flexibility is also essential in perception, so that the wide range of speakers one encounters, with their individual speech characteristics, can still be understood. Flexibility around baseline control is important in production so that communication can be tuned to specific situations, such as speaking more clearly to someone who does not speak the language natively. The sources of variability in speech will be examined in production experiments where the tongue, lips and other articulators are measured with such approaches as ultrasound and electromagnetic articulometry, and in perception experiments, where the output of the vocal tract variability can be measured for its ability to convey a message. Mathematical methods that use nonlinear dynamics will separate the controlled and random variability present in the production signals. The results will provide a better foundation for assessing speech difficulties, such as second language accent or stuttering, and should suggest new means of remediation. In these studies, biofeedback will be used to show the speaker what their tongue is doing and what it should be doing. The topics explored?articulator movement, articulatory settings, and variability?are globally applicable to speech in any language. They are foundational issues and thus not likely to be fully understood from any one set of studies, but the current studies will considerably advance our knowledge and our ability to model that knowledge.

Public Health Relevance

The proposed research addresses ways in which the vocal tract creates speech (production) and how listeners extract the underlying linguistically significant parts of the signal (perception), and the ways in which the two are linked. The research will use measurements and modeling to separate controlled from random variability. This will help to distinguish flexibility from lack of control, allowing the testing of new biofeedback techniques for speech remediation.

Agency
National Institute of Health (NIH)
Institute
National Institute on Deafness and Other Communication Disorders (NIDCD)
Type
Research Project (R01)
Project #
5R01DC002717-21
Application #
9985598
Study Section
Special Emphasis Panel (ZRG1)
Program Officer
Shekim, Lana O
Project Start
1996-05-01
Project End
2023-07-31
Budget Start
2020-08-01
Budget End
2021-07-31
Support Year
21
Fiscal Year
2020
Total Cost
Indirect Cost
Name
Haskins Laboratories, Inc.
Department
Type
DUNS #
060010147
City
New Haven
State
CT
Country
United States
Zip Code
06511
Derrick, Donald; Carignan, Christopher; Chen, Wei-Rong et al. (2018) Three-dimensional printable ultrasound transducer stabilization system. J Acoust Soc Am 144:EL392
Whalen, D H; Chen, Wei-Rong; Tiede, Mark K et al. (2018) Variability of articulator positions and formants across nine English vowels. J Phon 68:1-14
Krivokapi?, Jelena; Tiede, Mark K; Tyrone, Martha E (2017) A Kinematic Study of Prosodic Structure in Articulatory and Manual Gestures: Results from a Novel Method of Data Collection. Lab Phonol 8:
Abramson, Arthur S; Whalen, D H (2017) Voice Onset Time (VOT) at 50: Theoretical and practical issues in measuring voicing distinctions. J Phon 63:75-86
Roon, Kevin D; Gafos, Adamantios I (2016) Perceiving while producing: Modeling the dynamics of phonological planning. J Mem Lang 89:222-243
Shadle, Christine H; Nam, Hosung; Whalen, D H (2016) Comparing measurement errors for formants in synthetic and natural vowels. J Acoust Soc Am 139:713-27
Dawson, Katherine M; Tiede, Mark K; Whalen, D H (2016) Methods for quantifying tongue shape and complexity using ultrasound imaging. Clin Linguist Phon 30:328-44
Whalen, D H (2016) Direct Perceptions of Carol Fowler's Theoretical Perspective. Ecol Psychol 28:183-187
Bicevskis, Katie; Derrick, Donald; Gick, Bryan (2016) Visual-tactile integration in speech perception: Evidence for modality neutral speech primitives. J Acoust Soc Am 140:3531
Jackson, Eric S; Tiede, Mark; Riley, Michael A et al. (2016) Recurrence Quantification Analysis of Sentence-Level Speech Kinematics. J Speech Lang Hear Res 59:1315-1326

Showing the most recent 10 out of 72 publications