This is a revised application proposing to continue a program of research to investigate sensory and perceptual processes in spoken communication. The primary aim of the research is to develop an empirical description and a theoretical account of the perceptual organization of speech. An allied aim of the research is to characterize the perceptual organization of multimodal speech perception, in which auditory and visual attributes are combined in a unified speech stream despite the dissimilarity of auditory and visual sensation. Although the motivation for this research is theoretical, it is specifically relevant to understanding the utility of the electrocochlear prosthesis despite the anomalous auditory qualities it evokes. Although many studies on the normal listener seek to explain the perceptual analysis of linguistic properties conveyed by speech, the present project is concerned with more fundamental functions by which the perceive finds and follows a single speech signal among concurrent sensory activity.
This research aims to understand how the listener copes with apparently limitless variation in the superficial acoustic constituents of speech. In emphasizing the perceptual utility of abstract spectrotemporal properties, these studies may explain the robustness of speech perception with auditory qualities are altered or diminished by disease, and offers an opportunity to identify therapeutic accommodations for loss or failure of perceptual resources. Four projects comprising thirteen experiments are proposed for the coming five years. The research includes a set of studies with adult listeners to determine the contribution to the superficial acoustic form of speech signal elements to coarse grain phonetic perceptual organization; a detailed psychophysical evaluation of the interplay of auditory timbre and time-varying coherence in the perception of phonetic sequences composing words; a series of audiovisual tests of perceptual organization to analyze the phonetic effectiveness of spectrally and temporally manipulated acoustic components of speech in combination with a visual display of an articulating face; and, an appraisal of the perceptual reliance on time-varying acoustic structure that elicits the perception of the talker's identity as well as the spoken message. Together the investigations will elaborate fundamental processes of detecting and maintaining perceptual coherence, and will offer new evidence of the generality of a developing account of intermodal perception.
| Remez, Robert E; Rubin, Philip E (2016) PERCEPTUAL ORGANIZATION AND LAWFUL SPECIFICATION. Ecol Psychol 28:160-165 |
| Remez, Robert E; Thomas, Emily F; Wycoff, Andrea M et al. (2016) Constraints on Sensitivity to Auditory Modulation in the Perceptual Organization of Speech. Exp Aging Res 42:3-13 |
| Remez, Robert E (2015) ANALOGY AND DISANALOGY IN PRODUCTION AND PERCEPTION OF SPEECH. Lang Cogn Neurosci 30:273-286 |
| Remez, Robert E; Thomas, Emily F; Dubowski, Kathryn R et al. (2013) Modulation sensitivity in the perceptual organization of speech. Atten Percept Psychophys 75:1353-8 |
| Remez, Robert E; Thomas, Emily F (2013) Early recognition of speech. Wiley Interdiscip Rev Cogn Sci 4:213-223 |
| Remez, Robert E; Dubowski, Kathryn R; Broder, Robin S et al. (2011) Auditory-phonetic projection and lexical structure in the recognition of sine-wave words. J Exp Psychol Hum Percept Perform 37:968-77 |
| Remez, Robert E; Dubowski, Kathryn R; Davids, Morgana L et al. (2011) Estimating speech spectra for copy synthesis by linear prediction and by hand. J Acoust Soc Am 130:2173-8 |
| Remez, Robert E; Ferro, Daria F; Dubowski, Kathryn R et al. (2010) Is desynchrony tolerance adaptable in the perceptual organization of speech? Atten Percept Psychophys 72:2054-8 |
| Remez, Robert E; Dubowski, Kathryn R; Broder, Robin S et al. (2009) AUDITORY-PHONETIC PROJECTION AND LEXICAL STRUCTURE IN THE RECOGNITION OF SINE-WAVE WORDS. J Exp Psychol Hum Percept Perform 125:2656 |
