The primary aim of the proposed research is to investigate the hypothesis that language comprehension involves the use and manipulation of perceptual symbols. Perceptual symbols are representations stored in long-term memory, which are the result of the perceptual experience of an event or object. Perceptual symbols capture those aspects of an event or object that were in focused attention. Perceptual symbols can be activated, for instance, by verbal stimuli, thus recreating the perceptual experience in a perceptual simulation. Language can be thought of as a set of cues to the comprehender on how to run a perceptual simulation. This view can be contrasted with the amodal propositional view, which is currently prevalent in cognitive science. On this view, objects and events are represented by networks of abstract propositions constructed from the verbal input, which bear no analog relation to their referents. There is as yet no systematic body of empirical evidence regarding these competing hypotheses about the building blocks of cognition. Four sets of experiments are proposed that are intended as a first concerted attempt to fill this gap. The first set examines whether comprehenders mentally represent the orientation of objects when this is implied by the linguistic input. The second set examines whether comprehenders mentally represent the shape of objects or animals when this is implied by the verbal input. The third set examines whether language processing can result in representational motion. Finally, the fourth set examines whether the processing of words denoting parts of larger objects (e.g., """"""""lid,"""""""" """"""""elbow"""""""") activate perceptual representations of the larger object. The proposed research has theoretical and practical significance. In the theoretical domain, it addresses in a novel way the relation between mental representations and their referents in the context of language comprehension. As such, it is intended to yield new insights into the building blocks of cognition and into the relation between perception and cognition. In the practical domain, the proposed experiments could lead to the development of novel diagnostic tests to assess comprehension skill in various groups, including children, children with reading disability, older adults, older adults with Alzheimer's disease, and individuals with brain damage.
| Madden, Carol J; Dijkstra, Katinka (2010) Contextual constraints in situation model construction: an investigation of age and reading span. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn 17:19-34 |
| Richter, Tobias; Zwaan, Rolf A (2010) Integration of perceptual information in word access. Q J Exp Psychol (Hove) 63:81-107 |
| Therriault, David J; Yaxley, Richard H; Zwaan, Rolf A (2009) The role of color diagnosticity in object recognition and representation. Cogn Process 10:335-42 |
| Richter, Tobias; Zwaan, Rolf A; Hoever, Inga (2009) Acquiring experiential traces in word-referent learning. Mem Cognit 37:1187-96 |
| Richter, Tobias; Zwaan, Rolf A (2009) Processing of color words activates color representations. Cognition 111:383-9 |
| Fischer, Martin H; Zwaan, Rolf A (2008) Embodied language: a review of the role of the motor system in language comprehension. Q J Exp Psychol (Colchester) 61:825-50 |
| Taylor, Lawrence J; Zwaan, Rolf A (2008) Motor resonance and linguistic focus. Q J Exp Psychol (Colchester) 61:896-904 |
| Kaup, Barbara; Yaxley, Richard H; Madden, Carol J et al. (2007) Experiential simulations of negated text information. Q J Exp Psychol (Colchester) 60:976-90 |
| Dijkstra, Katinka; Kaschak, Michael P; Zwaan, Rolf A (2007) Body posture facilitates retrieval of autobiographical memories. Cognition 102:139-49 |
| Madden, Carol J; Zwaan, Rolf A (2006) Perceptual representation as a mechanism of lexical ambiguity resolution: An investigation of span and processing time. J Exp Psychol Learn Mem Cogn 32:1291-303 |
Showing the most recent 10 out of 20 publications
