The long-term goal of the research endeavor focuses on a theoretical account of bimodal speech perception, or speech perception by eye and ear. The research is carried out within the framework of the falsification and strong-inference paradigm to eliminate alternative interpretations and to provide constraints on proposed theoretical explanations. The experiments utilize the methodology of information processing, information integration, and the testing of mathematical models. A wide variety of experimental tasks perceptual judgments, and dependent variables are studied to provide converging operations on the phenomena of interest. The proposed research is aimed at understanding the evaluation and integration of auditory and visual information in speech perception. The experimental studies address 1) the ability to learn to attend selectively to one modality or the other in bimodal speech perception, 2) the degree to which preschool and adolescent children can be taught lipreading and the consequences of learning on bimodal speech perception, and 3) the psychophysical study of audible and visiblespeech involving the extension of forms of degradation of the auditory speech and the assessment of various forms of degradation of the auditory and visual signals.

Agency
National Institute of Health (NIH)
Institute
National Institute on Deafness and Other Communication Disorders (NIDCD)
Type
Research Project (R01)
Project #
5R01DC000236-09
Application #
3216216
Study Section
Hearing Research Study Section (HAR)
Project Start
1983-12-01
Project End
1990-11-30
Budget Start
1989-12-01
Budget End
1990-11-30
Support Year
9
Fiscal Year
1990
Total Cost
Indirect Cost
Name
University of California Santa Cruz
Department
Type
Schools of Arts and Sciences
DUNS #
City
Santa Cruz
State
CA
Country
United States
Zip Code
95064
Chen, Trevor H; Massaro, Dominic W (2008) Seeing pitch: visual information for lexical tones of Mandarin-Chinese. J Acoust Soc Am 123:2356-66
Massaro, Dominic W; Chen, Trevor H (2008) The motor theory of speech perception revisited. Psychon Bull Rev 15:453-7;discussion 458-62
Massaro, Dominic W; Bosseler, Alexis (2006) Read my lips: The importance of the face in a computer-animated tutor for vocabulary learning by children with autism. Autism 10:495-510
Massaro, Dominic W; Light, Joanna (2004) Using visible speech to train perception and production of speech for individuals with hearing loss. J Speech Lang Hear Res 47:304-20
Chen, Trevor H; Massaro, Dominic W (2004) Mandarin speech perception by ear and eye follows a universal principle. Percept Psychophys 66:820-36
Bosseler, Alexis; Massaro, Dominic W (2003) Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. J Autism Dev Disord 33:653-72
Srinivasan, Ravindra J; Massaro, Dominic W (2003) Perceiving prosody from the face and voice: distinguishing statements from echoic questions in English. Lang Speech 46:1-22
Massaro, D W; Cohen, M M; Campbell, C S et al. (2001) Bayes factor of model selection validates FLMP. Psychon Bull Rev 8:1-17
Massaro, D W; Cohen, M M (2000) Tests of auditory-visual integration efficiency within the framework of the fuzzy logical model of perception. J Acoust Soc Am 108:784-9
Massaro, D W; Cohen, M M (1999) Speech perception in perceivers with hearing loss: synergy of multiple modalities. J Speech Lang Hear Res 42:21-41

Showing the most recent 10 out of 17 publications