Visual systems must be matched (via evolution and learning over the lifespan) to the natural tasks organisms perform to survive and reproduce. Thus, it is of fundamental importance to analyze visual systems with respect to natural tasks and with respect to the statistical properties of natural stimuli relevant to performing those tasks. In our lab we call this ?natural systems analysis.? This novel approach to vision science is composed of several steps: (1) identify natural tasks, (2) measure the natural scene statistics relevant for those tasks, (3) determine how to optimally use those statistics to perform the tasks, given appropriate biological constraints, and (4) use the first three steps to formulate principled hypotheses which are tested and refined in behavioral or physiological experiments. Using a unique suite of measurement devices, computational tools, and psychophysical paradigms developed in our laboratory, we propose to tackle (within the framework of natural systems analysis) several fundamental tasks involving estimation of local properties in natural scenes:
(Aim 1) detection of occluding and partially-occluded targets in natural images, (Aim 2) detection of depth edges created by occluding surfaces and estimation local 3D surface orientation at the non-depth edge locations within those surfaces, and (Aim 3) estimation of disparity and local 2D motion. Many of the proposed studies will be the first to precisely characterize the statistical constraints in natural images underlying the visual system's ability to perform these tasks accurately. Many of the proposed studies will also be the first to measure performance in these fundamental tasks using natural stimuli. The product of the studies will be not only unique new measurements, but principled new models that can predict human performance under natural conditions and guide future neurophysiological studies of the underlying mechanisms. Strong preliminary results have been obtained in the previous project period for many of the proposed studies.

Public Health Relevance

Ultimate goals of vision science are to understand vision in the real world and to mitigate the effects of visual dysfunction on real-world performance. The proposed studies based on measuring the task-relevant statistics of natural images, and determining how best to use those statistical properties in natural tasks, will provide rigorous steps toward those ultimate goals and may produce useful image-processing applications.

National Institute of Health (NIH)
National Eye Institute (NEI)
Research Project (R01)
Project #
Application #
Study Section
Mechanisms of Sensory, Perceptual, and Cognitive Processes Study Section (SPC)
Program Officer
Wiggs, Cheri
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of Texas Austin
Schools of Arts and Sciences
United States
Zip Code
Wang, Jiaxing; Struebing, Felix L; Ferdous, Salma et al. (2018) Differential Exon Expression in a Large Family of Retinal Genes Is Regulated by a Single Trans Locus. Adv Exp Med Biol 1074:413-420
Geisler, Wilson S (2018) Psychometric functions of uncertain template matching observers. J Vis 18:1
Sebastian, Stephen; Geisler, Wilson S (2018) Decision-variable correlation. J Vis 18:3
Kim, Seha; Burge, Johannes (2018) The lawful imprecision of human surface tilt estimation in natural scenes. Elife 7:
Michel, Melchi M; Chen, Yuzhi; Seidemann, Eyal et al. (2018) Nonlinear Lateral Interactions in V1 Population Responses Explained by a Contrast Gain Control Model. J Neurosci 38:10069-10079
McCann, Brian C; Hayhoe, Mary M; Geisler, Wilson S (2018) Contributions of monocular and binocular cues to distance discrimination in natural scenes. J Vis 18:12
Sebastian, Stephen; Abrams, Jared; Geisler, Wilson S (2017) Constrained sampling experiments reveal principles of detection in natural scenes. Proc Natl Acad Sci U S A 114:E5731-E5740
Jaini, Priyank; Burge, Johannes (2017) Linking normative models of natural tasks to descriptive models of neural response. J Vis 17:16
Burge, Johannes; McCann, Brian C; Geisler, Wilson S (2016) Estimating 3D tilt from local image cues in natural scenes. J Vis 16:2
Burge, Johannes; Geisler, Wilson S (2015) Optimal speed estimation in natural image movies predicts human performance. Nat Commun 6:7900

Showing the most recent 10 out of 34 publications