Early vision segments the retinal image into objects, represents these objects in a manner in which they can be recognized, and guides attention to portions of the visual scene that require further scrutiny. Individual features such as lines and edges play a role in these processes, but often the statistics of visual images are at least as important. For example, in complex images, including naturalistic ones, only a small number of contrast contours represent object boundaries, and consequently objects are more reliably defined by discontinuities in image statistics, rather than by isolated features. Despite the impressive ability of the visual system to analyze scene statistics, previous work (including our studies in current and previous funding periods) indicates that this statistical processing is limited and specific. Motivated by these considerations, we propose four sets of experiments to define the mechanisms and limits of statistical processing of visual images, and how these processes interact with image segmentation, representation in visual working memory, and guidance of attention. Based on theoretical and functional considerations, we consider three classes of visual statistics: statistics that are available at the cortical input (such as luminance and contrast), statistics that require cortical analysis but only within local regions (higher-order elements of form), and statistics that require more long-range analysis (such as bilateral symmetry). The proposed experimental design will allow us to compare these modalities on a common footing, and the proposed modeling approach will determine how processing is shaped by detection of statistical elements, and by pooling of statistical information. The planned research will also lead to insights into how top-down influences such as attention modulate the computations carried out in early visual areas. There are two broad hypotheses: A. The kinds of statistics used by early vision are determined by the spatial selectivity of visual processing, rather than considerations related to formal information content. B. The capacity for processing of visual statistics, though ultimately constrained by computational resources, is more typically tuned to, or modulated by, task demands.
Rucci, Michele; Victor, Jonathan D (2018) Perspective: Can eye movements contribute to emmetropization? J Vis 18:10 |
Victor, Jonathan D; Conte, Mary M; Chubb, Charles F (2017) Textures as Probes of Visual Processing. Annu Rev Vis Sci 3:275-296 |
Boi, Marco; Poletti, Martina; Victor, Jonathan D et al. (2017) Consequences of the Oculomotor Cycle for the Dynamics of Perception. Curr Biol 27:1268-1277 |
Victor, Jonathan D; Rizvi, Syed M; Conte, Mary M (2017) Two representations of a high-dimensional perceptual space. Vision Res 137:1-23 |
Joukes, Jeroen; Yu, Yunguo; Victor, Jonathan D et al. (2017) Recurrent Network Dynamics; a Link between Form and Motion. Front Syst Neurosci 11:12 |
Hu, Qin; Victor, Jonathan D (2016) Two-Dimensional Hermite Filters Simplify the Description of High-Order Statistics of Natural Images. Symmetry (Basel) 8: |
Nitzany, Eyal I; Loe, Maren E; Palmer, Stephanie E et al. (2016) Perceptual interaction of local motion signals. J Vis 16:22 |
Victor, Jonathan D; Thengone, Daniel J; Rizvi, Syed M et al. (2015) A perceptual space of local image statistics. Vision Res 117:117-35 |
Rucci, Michele; Victor, Jonathan D (2015) The unsteady eye: an information-processing stage, not a bug. Trends Neurosci 38:195-206 |
Aytekin, Murat; Victor, Jonathan D; Rucci, Michele (2014) The visual input to the retina during natural head-free fixation. J Neurosci 34:12701-15 |
Showing the most recent 10 out of 69 publications