Recent research in this laboratory has demonstrated that 4-month-old infants recognize the correspondence between auditorially and visually presented speech sounds. They recognize that particular sounds emanate from mouths moving in particular ways, thus demonstrating one of the components of """"""""lip-reading"""""""" in adults. This ability has important implications for the development of sensory and perceptual processing, particularly of speech, in normal infants. The experiments proposed here extend our research on auditory-visual speech perception in infants in four ways. First, the research examines the extent of the effect, extending the experiments to more difficult examples. Second, it examines the development of the effect, extending the age range tested to under three weeks of age. Third, the proposal examines the basis of the effect, testing whether infants recognize auditory-visual correspondences when complex nonspeech sounds are used. Fourth, it examines the nature of the interaction in auditory-visual speech perception, using experiments that probe the nature of the metric by which optic and acoustic information for speech is equated. At a theoretical level, the experimental outcomes are directly relevant to models of speech perception and vocal learning in infancy and should also enrich our understanding of social and cognitive development in normal infants. The data may also impact our understanding and treatment strategies for infants born deaf or blind.

Agency
National Institute of Health (NIH)
Institute
Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD)
Type
Research Project (R01)
Project #
5R01HD018286-03
Application #
3315319
Study Section
Communication Sciences and Disorders (CMS)
Project Start
1983-12-01
Project End
1986-11-30
Budget Start
1985-12-01
Budget End
1986-11-30
Support Year
3
Fiscal Year
1986
Total Cost
Indirect Cost
Name
University of Washington
Department
Type
Schools of Arts and Sciences
DUNS #
135646524
City
Seattle
State
WA
Country
United States
Zip Code
98195
Green, K P; Tomiak, G R; Kuhl, P K (1997) The encoding of rate and talker information during phonetic perception. Percept Psychophys 59:675-92
Kuhl, P K; Meltzoff, A N (1996) Infant vocalizations in response to speech: vocal imitation and developmental change. J Acoust Soc Am 100:2425-38
Green, K P; Stevens, E B; Kuhl, P K (1994) Talker continuity and the use of rate information during phonetic perception. Percept Psychophys 55:249-60
Kuhl, P K (1994) Learning and representation in speech and language. Curr Opin Neurobiol 4:812-22
Kuhl, P K; Williams, K A; Meltzoff, A N (1991) Cross-modal speech perception in adults and infants using nonspeech auditory stimuli. J Exp Psychol Hum Percept Perform 17:829-40
Green, K P; Kuhl, P K (1991) Integral processing of visual place and auditory voicing information during phonetic perception. J Exp Psychol Hum Percept Perform 17:278-88
Green, K P; Kuhl, P K; Meltzoff, A N et al. (1991) Integrating speech information across talkers, gender, and sensory modality: female faces and male voices in the McGurk effect. Percept Psychophys 50:524-36
Green, K P; Kuhl, P K (1989) The role of visual information in the processing of place and manner features in speech perception. Percept Psychophys 45:34-42
Kuhl, P K (1986) Theoretical contributions of tests on animals to the special-mechanisms debate in speech. Exp Biol 45:233-65