Early vision segments the retinal image into objects, represents these objects in a manner in which they can be recognized, and guides attention to portions of the visual scene that require further scrutiny. Individual features such as lines and edges play a role in these processes, but often the statistics of visual images are at least as important. For example, in complex images, including naturalistic ones, only a small number of contrast contours represent object boundaries, and consequently objects are more reliably defined by discontinuities in image statistics, rather than by isolated features. Despite the impressive ability of the visual system to analyze scene statistics, previous work (including our studies in current and previous funding periods) indicates that this statistical processing is limited and specific. Motivated by these considerations, we propose four sets of experiments to define the mechanisms and limits of statistical processing of visual images, and how these processes interact with image segmentation, representation in visual working memory, and guidance of attention. Based on theoretical and functional considerations, we consider three classes of visual statistics: statistics that are available at the cortical input (such as luminance and contrast), statistics that require cortical analysis but only within local regions (higher-order elements of form), and statistics that require more long-range analysis (such as bilateral symmetry). The proposed experimental design will allow us to compare these modalities on a common footing, and the proposed modeling approach will determine how processing is shaped by detection of statistical elements, and by pooling of statistical information. The planned research will also lead to insights into how top-down influences such as attention modulate the computations carried out in early visual areas. There are two broad hypotheses: A. The kinds of statistics used by early vision are determined by the spatial selectivity of visual processing, rather than considerations related to formal information content. B. The capacity for processing of visual statistics, though ultimately constrained by computational resources, is more typically tuned to, or modulated by, task demands.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
5R01EY007977-17
Application #
6844638
Study Section
Visual Sciences B Study Section (VISB)
Program Officer
Oberdorfer, Michael
Project Start
1989-01-01
Project End
2007-01-31
Budget Start
2005-02-01
Budget End
2006-01-31
Support Year
17
Fiscal Year
2005
Total Cost
$330,240
Indirect Cost
Name
Weill Medical College of Cornell University
Department
Neurology
Type
Schools of Medicine
DUNS #
060217502
City
New York
State
NY
Country
United States
Zip Code
10065
Rucci, Michele; Victor, Jonathan D (2018) Perspective: Can eye movements contribute to emmetropization? J Vis 18:10
Victor, Jonathan D; Conte, Mary M; Chubb, Charles F (2017) Textures as Probes of Visual Processing. Annu Rev Vis Sci 3:275-296
Boi, Marco; Poletti, Martina; Victor, Jonathan D et al. (2017) Consequences of the Oculomotor Cycle for the Dynamics of Perception. Curr Biol 27:1268-1277
Victor, Jonathan D; Rizvi, Syed M; Conte, Mary M (2017) Two representations of a high-dimensional perceptual space. Vision Res 137:1-23
Joukes, Jeroen; Yu, Yunguo; Victor, Jonathan D et al. (2017) Recurrent Network Dynamics; a Link between Form and Motion. Front Syst Neurosci 11:12
Hu, Qin; Victor, Jonathan D (2016) Two-Dimensional Hermite Filters Simplify the Description of High-Order Statistics of Natural Images. Symmetry (Basel) 8:
Nitzany, Eyal I; Loe, Maren E; Palmer, Stephanie E et al. (2016) Perceptual interaction of local motion signals. J Vis 16:22
Victor, Jonathan D; Thengone, Daniel J; Rizvi, Syed M et al. (2015) A perceptual space of local image statistics. Vision Res 117:117-35
Rucci, Michele; Victor, Jonathan D (2015) The unsteady eye: an information-processing stage, not a bug. Trends Neurosci 38:195-206
Aytekin, Murat; Victor, Jonathan D; Rucci, Michele (2014) The visual input to the retina during natural head-free fixation. J Neurosci 34:12701-15

Showing the most recent 10 out of 69 publications