The long-term goal of the research endeavor focuses on a theoretical account of bimodal speech perception, or speech perception by eye and ear. The research is carried out within the framework of the falsification and strong-inference paradigm to eliminate alternative interpretations and to provide constraints on proposed theoretical explanations. The experiments utilize the methodology of information processing, information integration, and the testing of mathematical models. A wide variety of experimental tasks perceptual judgments, and dependent variables are studied to provide converging operations on the phenomena of interest. The proposed research is aimed at understanding the evaluation and integration of auditory and visual information in speech perception. The experimental studies address 1) the ability to learn to attend selectively to one modality or the other in bimodal speech perception, 2) the degree to which preschool and adolescent children can be taught lipreading and the consequences of learning on bimodal speech perception, and 3) the psychophysical study of audible and visiblespeech involving the extension of forms of degradation of the auditory speech and the assessment of various forms of degradation of the auditory and visual signals.

National Institute of Health (NIH)
National Institute of Neurological Disorders and Stroke (NINDS)
Research Project (R01)
Project #
Application #
Study Section
Hearing Research Study Section (HAR)
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of California Santa Cruz
Schools of Arts and Sciences
Santa Cruz
United States
Zip Code
Smeele, P M; Massaro, D W; Cohen, M M et al. (1998) Laterality in visual speech perception. J Exp Psychol Hum Percept Perform 24:1232-42
Weldon, M S; Massaro, D W (1996) Integration of orthographic, conceptual, and episodic information on implicit and explicit tests. Can J Exp Psychol 50:72-86
Massaro, D W; Cohen, M M; Smeele, P M (1995) Cross-linguistic comparisons in the integration of visual and auditory speech. Mem Cognit 23:113-31
Massaro, D W; Oden, G C (1995) Independence of lexical context and phonological information in speech perception. J Exp Psychol Learn Mem Cogn 21:1053-64
Thompson, L A; Massaro, D W (1994) Children's integration of speech and pointing gestures in comprehension. J Exp Child Psychol 57:327-54
Massaro, D W; Cohen, M M (1994) Visual, orthographic, phonological, and lexical influences in reading. J Exp Psychol Hum Percept Perform 20:1107-28
Massaro, D W (1994) A pattern recognition account of decision making. Mem Cognit 22:616-27
Massaro, D W; Cohen, M M (1993) The paradigm and the fuzzy logical model of perception are alive and well. J Exp Psychol Gen 122:115-24
Massaro, D W; Cohen, M M; Gesi, A T (1993) Long-term training, transfer, and retention in learning to lipread. Percept Psychophys 53:549-62
Massaro, D W; Cowan, N (1993) Information processing models: microscopes of the mind. Annu Rev Psychol 44:383-425

Showing the most recent 10 out of 14 publications