Research in this laboratory has demonstrated that 4-month-old infants recognize the correspondence between auditorially and visually presented speech sounds. They recognize that particular sounds emanate from mouths moving in particular ways, thus demonstrating one of the components of """"""""lip-reading."""""""" Our current work shows that infants also relate nonspeech sounds to faces producing speech, and base this on their knowledge of speech. This finding led to the development of a hypothesis that accounts for our results of infants' cross-modal speech perception. The experiments proposed here extend our tests in four ways. First, following our new hypothesis, we continue studies on the basis of the effect, manipulating the visual stimuli (i.e., the faces) in these experiments. Second, we extend the studies on the development of the effect to include infants (1-14 months of age), children (3-year-olds), and adults. Third, we will initiate studies assessing the effects of visually presented rate-of-speech information. Fourth, using a new technique that isolates """"""""parts"""""""" of faces, we explore auditory-visual """"""""illusions"""""""" (the McGurk effect) in both adults and infants. The experimental outcomes are directly relevant to theories of speech perception and its development, as well as to theories of cognitive development. The data may also impact our understanding and treatment strategies for deaf of blind infants.

Agency
National Institute of Health (NIH)
Institute
Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD)
Type
Research Project (R01)
Project #
5R01HD018286-07
Application #
3315322
Study Section
Sensory Disorders and Language Study Section (CMS)
Project Start
1983-12-01
Project End
1991-11-30
Budget Start
1989-12-01
Budget End
1991-11-30
Support Year
7
Fiscal Year
1990
Total Cost
Indirect Cost
Name
University of Washington
Department
Type
Schools of Arts and Sciences
DUNS #
135646524
City
Seattle
State
WA
Country
United States
Zip Code
98195
Green, K P; Tomiak, G R; Kuhl, P K (1997) The encoding of rate and talker information during phonetic perception. Percept Psychophys 59:675-92
Kuhl, P K; Meltzoff, A N (1996) Infant vocalizations in response to speech: vocal imitation and developmental change. J Acoust Soc Am 100:2425-38
Green, K P; Stevens, E B; Kuhl, P K (1994) Talker continuity and the use of rate information during phonetic perception. Percept Psychophys 55:249-60
Kuhl, P K (1994) Learning and representation in speech and language. Curr Opin Neurobiol 4:812-22
Green, K P; Kuhl, P K (1991) Integral processing of visual place and auditory voicing information during phonetic perception. J Exp Psychol Hum Percept Perform 17:278-88
Green, K P; Kuhl, P K; Meltzoff, A N et al. (1991) Integrating speech information across talkers, gender, and sensory modality: female faces and male voices in the McGurk effect. Percept Psychophys 50:524-36
Kuhl, P K; Williams, K A; Meltzoff, A N (1991) Cross-modal speech perception in adults and infants using nonspeech auditory stimuli. J Exp Psychol Hum Percept Perform 17:829-40
Green, K P; Kuhl, P K (1989) The role of visual information in the processing of place and manner features in speech perception. Percept Psychophys 45:34-42
Kuhl, P K (1986) Theoretical contributions of tests on animals to the special-mechanisms debate in speech. Exp Biol 45:233-65