Vision naturally occurs in the context of voluntary information gathering movements involving the eyes, head, and hand. A central issue emerging from this is the nature of the brain's internal visual representations that direct this ongoing behavior. In this grant I propose to examine aspects of visual processing that arise when vision is considered in its normal behavioral context. The experiments examine the extent to which elemental visual representations are computed moment by moment explicitly for the immediate task, and the extent to which a more general purpose visual representation is maintained and updated as the observer moves within a scene. In addition we will gather new data on the characteristics of naturally occurring eye, head, and hand movements and their spatial and temporal coordination. Our objective is to understand the demands placed on the visual system by natural behavior and the nature of the representations that are required for visually guided tasks. Most of the experiments are embedded within a simple visuo-motor task which is representative of a range of natural visual performance but has a loose trial-like structure and is constrained enough to allow controlled experimental manipulation. One group of experiments are aimed at defining the nature of the visual information which is retained across saccadic eye movements, whether it is limited strictly by the current task, or more generally by the spatial region attended, or whether some more global aspects of the unattended portions of the scene are also preserved. Another group of experiments use new technology to monitor eye, head, and hand movements in an unrestrained observer and investigates the characteristics of naturally occurring eye and head movements and how they are spatially coordinated.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
5R01EY005729-16
Application #
2838271
Study Section
Visual Sciences B Study Section (VISB)
Project Start
1984-07-01
Project End
2000-08-01
Budget Start
1998-12-01
Budget End
2000-08-01
Support Year
16
Fiscal Year
1999
Total Cost
Indirect Cost
Name
University of Rochester
Department
Miscellaneous
Type
Schools of Arts and Sciences
DUNS #
208469486
City
Rochester
State
NY
Country
United States
Zip Code
14627
Matthis, Jonathan Samir; Yates, Jacob L; Hayhoe, Mary M (2018) Gaze and the Control of Foot Placement When Walking in Natural Terrain. Curr Biol 28:1224-1233.e5
Li, Chia-Ling; Aivar, M Pilar; Tong, Matthew H et al. (2018) Memory shapes visual search strategies in large-scale environments. Sci Rep 8:4324
McCann, Brian C; Hayhoe, Mary M; Geisler, Wilson S (2018) Contributions of monocular and binocular cues to distance discrimination in natural scenes. J Vis 18:12
Hayhoe, Mary M (2018) Davida Teller Award Lecture 2017: What can be learned from natural behavior? J Vis 18:10
Tong, Matthew H; Zohar, Oran; Hayhoe, Mary M (2017) Control of gaze while walking: Task structure, reward, and uncertainty. J Vis 17:28
Li, Chia-Ling; Aivar, M Pilar; Kit, Dmitry M et al. (2016) Memory and visual search in naturalistic 2D and 3D environments. J Vis 16:9
Boucart, Muriel; Delerue, Celine; Thibaut, Miguel et al. (2015) Impact of Wet Macular Degeneration on the Execution of Natural Actions. Invest Ophthalmol Vis Sci 56:6832-8
Gottlieb, Jacqueline; Hayhoe, Mary; Hikosaka, Okihide et al. (2014) Attention, reward, and information seeking. J Neurosci 34:15497-504
Kit, Dmitry; Katz, Leor; Sullivan, Brian et al. (2014) Eye movements, visual search and scene memory, in an immersive virtual environment. PLoS One 9:e94362
Hayhoe, Mary; Ballard, Dana (2014) Modeling task control of eye movements. Curr Biol 24:R622-8

Showing the most recent 10 out of 23 publications