Our understanding of human visual cognition is based almost exclusively on studies of image-based stimuli. The human visual system has evolved to perceive and interact with real objects, yet almost nothing is known about behavioral and brain-based responses to real-world complex objects, or how these differ from comparatively impoverished image displays. The long-term goal of this research is to elucidate the full set of underlying mechanisms that are engaged in real object perception. The research will provide unprecedented insight into, and comprehensive scientific understanding of, psychological and neural systems implicated in this domain. The objective of this application is to understand how and why real-world stimuli, compared with images, influence cognition, behavior, and neural responses. The central hypothesis is that real objects are processed and represented differently to images because they are relevant for genuine goal-directed action, and neural systems that are engaged in action are also recruited in the service of perception and cognition. The central hypothesis is formulated on the basis of preliminary behavioral, neuropsychological, and fMRI data produced by the applicants. The rationale for the research is that studying richer stimuli that match the characteristics of objects that are encountered in everyday life will fundamentally improve our understanding of cognition, and, thereby, expand the generalizability and translational value of scientific knowledge to real-world environments and settings. The central hypothesis will be tested by pursuing three specific aims: (1) Determine how perception and recognition processes differ for real objects vs. images; (2) Determine how memory processes differ for real objects vs. images; and (3) Determine how visual exploration and attention differ for real objects vs. images. These fundamental processes will be examined using behavioral and/or fMRI studies in healthy observers and neuropsychological patients with perceptual deficits. The studies involve real life-sized objects with natural surface texture, compliance, and weight. The objects have a definite size, distance, and location from the observer, and most importantly, they afford genuine actions such as grasping and manipulation. The studies employ novel and innovative experimental devices, procedures, and paradigms, designed for presenting large numbers of real objects in rapid succession in the laboratory and the fMRI scanner, under controlled viewing conditions. Together, these stimuli and techniques will serve as benchmarks for researchers and clinicians exploring real-object effects on behavior and neural coding. The contribution of the proposed research is that it will elucidate fully the underlying processes and mechanisms that are engaged in real-world cognition, and will shift current research paradigms that focus on images to more ecologically valid stimuli. This contribution is significant because it will reveal, for th first time, how the integrated workings of the perceptuo-motor system fundamentally shape visual cognition, why these systems should be studied with real graspable stimuli, and how their joint activity influences and improves performance.
Our 'real-world' approach to the study of visual cognition is relevant to public health because it will provide fundamental new insights into how realistic stimulus displays can improve perception, recognition, memory, and attention, in healthy and brain-damaged individuals. The research will shed new light on perceptual abilities that are spared, but as yet poorly understood, in patients with visual agnosia, and will ultimately lead to the development of more effective assessment and rehabilitation approaches for patients with sensory, perceptual, and motor deficits, thereby reducing the burdens of human disability.
| Romero, Carissa A; Compton, Michael T; Yang, Yueran et al. (2018) The real deal: Willingness-to-pay and satiety expectations are greater for real foods versus their images. Cortex 107:78-91 |
| Chen, Juan; Snow, Jacqueline C; Culham, Jody C et al. (2018) What Role Does ""Elongation"" Play in ""Tool-Specific"" Activation and Connectivity in the Dorsal and Ventral Visual Streams? Cereb Cortex 28:1117-1131 |
| Gomez, Michael A; Skiba, Rafal M; Snow, Jacqueline C (2018) Graspable Objects Grab Attention More Than Images Do. Psychol Sci 29:206-218 |
| Gomez, Michael A; Snow, Jacqueline C (2017) Action properties of object images facilitate visual search. J Exp Psychol Hum Percept Perform 43:1115-1124 |
| Skiba, Rafal M; Snow, Jacqueline C (2016) Attentional capture for tool images is driven by the head end of the tool, not the handle. Atten Percept Psychophys 78:2500-2514 |
