Though current computational models of visual processing provide a good account of processing of simple images such as lines and gratings, our understanding of the processing of natural scenes is substantially incomplete. Several lines of reasoning indicate that the fundamental reason for this is that current models do not account for sensitivity to higher-order image statistics - the distinguishing feature of natural scenes. Until now, sensitivity to high-order image statistics has eluded systematic study because they constitute an enormous set of parameters. The goal of this research is to surmount this barrier. Via psychophysical studies of texture perception, we propose to test two powerful hypotheses that will tame the complex domain of high-order image statistics.
Aim 1 will test a hypothesis that simplifies how image statistics combine. Specifically, we hypothesize that the interaction of pairs of image statistics can be described by a quadratic combination rule, and interactions of multiple image statistics can be predicted from their pair wise interactions.
Aim 2 will test the hypothesis that only small subsets of image statistics are visually salient. Specifically, we hypothesize that only two kinds of image statistics - """"""""first-order histogram statistics"""""""" and """"""""local correlation statistics"""""""" - are visually salient, and that a much larger set of image statistics, """"""""high-order histogram statistics"""""""", are not perceptually relevant.
Aim 3 will combine these two simplifying strategies, to account for perception of the complex multiscale high-order statistics present in natural scenes.

Public Health Relevance

The long-term goal of this project is to understand how the brain analyzes incoming visual information. An enhanced understanding of this process will advance our ability to diagnose and remediate disturbances of perception, which cause significant morbidity in conditions as disparate as amblyopic, Alzheimer's disease and stroke.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
2R01EY007977-19A2
Application #
7580305
Study Section
Central Visual Processing Study Section (CVP)
Program Officer
Steinmetz, Michael A
Project Start
1989-01-01
Project End
2011-06-30
Budget Start
2009-07-01
Budget End
2010-06-30
Support Year
19
Fiscal Year
2009
Total Cost
$392,961
Indirect Cost
Name
Weill Medical College of Cornell University
Department
Neurology
Type
Schools of Medicine
DUNS #
060217502
City
New York
State
NY
Country
United States
Zip Code
10065
Rucci, Michele; Victor, Jonathan D (2018) Perspective: Can eye movements contribute to emmetropization? J Vis 18:10
Victor, Jonathan D; Conte, Mary M; Chubb, Charles F (2017) Textures as Probes of Visual Processing. Annu Rev Vis Sci 3:275-296
Boi, Marco; Poletti, Martina; Victor, Jonathan D et al. (2017) Consequences of the Oculomotor Cycle for the Dynamics of Perception. Curr Biol 27:1268-1277
Victor, Jonathan D; Rizvi, Syed M; Conte, Mary M (2017) Two representations of a high-dimensional perceptual space. Vision Res 137:1-23
Joukes, Jeroen; Yu, Yunguo; Victor, Jonathan D et al. (2017) Recurrent Network Dynamics; a Link between Form and Motion. Front Syst Neurosci 11:12
Hu, Qin; Victor, Jonathan D (2016) Two-Dimensional Hermite Filters Simplify the Description of High-Order Statistics of Natural Images. Symmetry (Basel) 8:
Nitzany, Eyal I; Loe, Maren E; Palmer, Stephanie E et al. (2016) Perceptual interaction of local motion signals. J Vis 16:22
Victor, Jonathan D; Thengone, Daniel J; Rizvi, Syed M et al. (2015) A perceptual space of local image statistics. Vision Res 117:117-35
Rucci, Michele; Victor, Jonathan D (2015) The unsteady eye: an information-processing stage, not a bug. Trends Neurosci 38:195-206
Aytekin, Murat; Victor, Jonathan D; Rucci, Michele (2014) The visual input to the retina during natural head-free fixation. J Neurosci 34:12701-15

Showing the most recent 10 out of 69 publications