This research monitors eye movements to objects in a visual workspace, which are closely time-locked to language production and comprehension, as participants perform natural tasks, such as following producing and following instructions, and conversing to solve problems using the objects. The goal is to understand how listeners coordinate linguistic and non-linguistic information as they understand language. Coordinating information is central to language comprehension because speech unfolds as a rapidly changing transient acoustic event. As a consequence, listeners encounter ambiguities at multiple levels of linguistic representation (e.g., phonetic, lexical, syntactic, semantic/discourse model, etc.). Many ambiguities are temporary in that subsequent linguistic information soon resolves the ambiguity; others are resolved by appeal to non-linguistic context-the particular circumstances under which an utterance is heard or read; others by appeal to real-world knowledge. The ambiguity problem is pervasive: even unambiguous words and phrases are temporarily ambiguous. Yet, comprehenders quickly coordinate multiple sources of information to arrive at provisional interpretations as the speech unfolds. The results of this research are used to develop and evaluate explicit mechanistic models that support real-time comprehension and can account for the major empirical phenomena. These models are essential for understanding normal comprehension and its development, developmental disabilities, and comprehension impairments that may arise from brain injury. The results and methods that arise from this investigation are also becoming increasingly relevant to informing and evaluating computer-based spoken dialog systems. These systems are beginning to find applications in health-related domains (e.g., systems that interact with humans using spoken language to answer queries) and prototypes are under development that offer advice, for example, in coordinating rapid response to medical emergencies.

Agency
National Institute of Health (NIH)
Institute
Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD)
Type
Research Project (R01)
Project #
5R01HD027206-17
Application #
7475834
Study Section
Special Emphasis Panel (ZRG1-BBBP-H (02))
Program Officer
Mccardle, Peggy D
Project Start
2005-05-24
Project End
2010-04-30
Budget Start
2008-05-01
Budget End
2009-04-30
Support Year
17
Fiscal Year
2008
Total Cost
$242,666
Indirect Cost
Name
University of Rochester
Department
Other Basic Sciences
Type
Schools of Arts and Sciences
DUNS #
041294109
City
Rochester
State
NY
Country
United States
Zip Code
14627
Kurumada, Chigusa; Brown, Meredith; Tanenhaus, Michael K (2018) Effects of distributional information on categorization of prosodic contours. Psychon Bull Rev 25:1153-1160
Yildirim, Ilker; Degen, Judith; Tanenhaus, Michael K et al. (2016) Talker-specificity and adaptation in quantifier interpretation. J Mem Lang 87:128-143
Ibarra, Alyssa; Tanenhaus, Michael K (2016) The Flexibility of Conceptual Pacts: Referring Expressions Dynamically Shift to Accommodate New Conceptualizations. Front Psychol 7:561
Degen, Judith; Tanenhaus, Michael K (2016) Availability of Alternatives and the Processing of Scalar Implicatures: A Visual World Eye-Tracking Study. Cogn Sci 40:172-201
Gegg-Harrison, Whitney M; Tanenhaus, Michael K (2016) What's in a Name? Interlocutors Dynamically Update Expectations about Shared Names. Front Psychol 7:212
Heller, Daphna; Arnold, Jennifer E; Klein, Natalie et al. (2015) Inferring Difficulty: Flexibility in the Real-time Processing of Disfluency. Lang Speech 58:190-203
Pogue, Amanda; Kurumada, Chigusa; Tanenhaus, Michael K (2015) Talker-Specific Generalization of Pragmatic Inferences based on Under- and Over-Informative Prenominal Adjective Use. Front Psychol 6:2035
Brown, Meredith; Salverda, Anne Pier; Dilley, Laura C et al. (2015) Metrical expectations from preceding prosody influence perception of lexical stress. J Exp Psychol Hum Percept Perform 41:306-23
Degen, Judith; Tanenhaus, Michael K (2015) Processing scalar implicature: a constraint-based approach. Cogn Sci 39:667-710
Brown, Meredith; Salverda, Anne Pier; Gunlogson, Christine et al. (2015) Interpreting prosodic cues in discourse context. Lang Cogn Neurosci 30:149-166

Showing the most recent 10 out of 51 publications