As research in speech production becomes more integrated with linguistic theory, it has become increasingly clear that segmental articulation cannot be understood independently of prosodic structure; such structure includes, but is not limited to, accent and phrasal organization. These high-level prosodic aspects of language pervade low-level articulatory behavior. Despite the pervasiveness of these effects, only a very few prosodic signatures have been identified at the level of articulatory patterning. The long term objective of the proposed research program is to understand how linguistic structure conditions the spatiotemporal realization of speech. Specifically, we investigate the relation between one aspect of prosodic structure -- phrasal structure -- and the control and coordination of articulation within a dynamical systems model of speech production. We adopt a three-pronged approach: experimental, theoretical, and computational. Experiments using articulatory kinematic data and concomitant computational modeling of their results will provide a profile of the manner in which patterning of articulatory gestures is shaped by prosodic context. Understanding the organization of these units of speech production as a function of the informational composition of utterances is critical to developing a unified account of the how abstract linguistic structure is communicated in spoken language. Hence, the research program will provide valuable insight into disorders, such as apraxia, that affect language production at the articulatory level, and it will contribute to a better understanding of prosody for speech recognition and synthesis purposes, also of importance to those with communication disorders.

Agency
National Institute of Health (NIH)
Institute
National Institute on Deafness and Other Communication Disorders (NIDCD)
Type
Research Project (R01)
Project #
5R01DC003172-09
Application #
6938544
Study Section
Special Emphasis Panel (ZRG1-BBBP-4 (04))
Program Officer
Shekim, Lana O
Project Start
1997-07-01
Project End
2006-08-31
Budget Start
2005-09-01
Budget End
2006-08-31
Support Year
9
Fiscal Year
2005
Total Cost
$369,688
Indirect Cost
Name
University of Southern California
Department
Miscellaneous
Type
Schools of Arts and Sciences
DUNS #
072933393
City
Los Angeles
State
CA
Country
United States
Zip Code
90089
Harper, Sarah; Lee, Sungbok; Goldstein, Louis et al. (2018) Simultaneous electromagnetic articulography and electroglottography data acquisition of natural speech. J Acoust Soc Am 144:EL380
Gupta, Rahul; Audhkhasi, Kartik; Jacokes, Zach et al. (2018) Modeling multiple time series annotations as noisy distortions of the ground truth: An Expectation-Maximization approach. IEEE Trans Affect Comput 9:76-89
Gupta, Rahul; Audhkhasi, Kartik; Lee, Sungbok et al. (2016) Detecting paralinguistic events in audio stream using context in features and probabilistic decisions. Comput Speech Lang 36:72-92
Gupta, Rahul; Bone, Daniel; Lee, Sungbok et al. (2016) Analysis of engagement behavior in children during dyadic interactions using prosodic cues. Comput Speech Lang 37:47-66
Ramanarayanan, Vikram; Van Segbroeck, Maarten; Narayanan, Shrikanth S (2016) Directly data-derived articulatory gesture-like representations retain discriminatory information about phone categories. Comput Speech Lang 36:330-346
Bone, Daniel; Lee, Chi-Chun; Black, Matthew P et al. (2014) The psychologist as an interlocutor in autism spectrum disorder assessment: insights from a study of spontaneous prosody. J Speech Lang Hear Res 57:1162-77
Parrell, Benjamin; Goldstein, Louis; Lee, Sungbok et al. (2014) Spatiotemporal coupling between speech and manual motor actions. J Phon 42:1-11
Bone, Daniel; Lee, Chi-Chun; Narayanan, Shrikanth (2014) Robust Unsupervised Arousal Rating: A Rule-Based Framework with Knowledge-Inspired Vocal Features. IEEE Trans Affect Comput 5:201-213
Kim, Jangwon; Lammert, Adam C; Ghosh, Prasanta Kumar et al. (2014) Co-registration of speech production datasets from electromagnetic articulography and real-time magnetic resonance imaging. J Acoust Soc Am 135:EL115-21
Ramanarayanan, Vikram; Lammert, Adam; Goldstein, Louis et al. (2014) Are articulatory settings mechanically advantageous for speech motor control? PLoS One 9:e104168

Showing the most recent 10 out of 37 publications