The overall goal of the research is to determine the nature of early vision's representation of the visual world, and the design principles of visual cortical function. The proposal centers on testing a hypothesis that embodies the efficient coding principle: that the representation of the visual world is based on extracting the local image statistics that are the most informative about natural images. That is, in order to make optimal use of its limited resources, the visual system omits an explicit representation of aspects of natural images that are predictable, so that it can concentrate its resources on what is not predictable, and therefore, informative. While this notion has been widely successful as an organizing principle for understanding retinal processing, its application to visual cortex has been much more limited, in part because of the complex structure of natural scenes. The planned approach overcomes this barrier, through the use of a novel mathematical strategy that recognizes the complex characteristics of the sensory environment. Implementing this approach leads to a range of specific (and occasionally surprising) predictions, owing in large part to the complex structure of natural scenes and their statistical regularities. If supported by the experimental results, the resulting view of early visual processing will broaden current notions of the calculations that neural circuitry performs, beyond simple filtering and feature extraction.
Aim 1 consists of three sets of experiments to test predictions of the hypothesis in a comprehensive way. Specifically, Aim 1A determines whether the distribution of local image statistics accounts for perceptual sensitivity to first, second, third, and fourth-order statistics.
Aim 1 B determines whether the scale-invariance of image statistics in natural scenes is mirrored by a scale-invariance of perceptual salience.
Aim 1 C extends the analysis from binary images (used in Aims 1A and 1B for simplicity) to gray-level images, and uses psychophysical results to predict as-yet unrecognized regularities in natural images. Since it is important to understand not only the overall goal of visual processing, but also how it is achieved, Aim 2 characterizes the computational mechanisms that underlie extraction of image statistics. Specifically, Aim 2A focuses on dynamics, and how these calculations evolve as the perception of an image advances in time from a "gist" to a detailed appreciation.
Aim 2 B determines whether image statistics are calculated via a discrete set of mechanisms likely to be embodied in dedicated circuitry, vs. a continuum of virtual ones. Successful completion of this research will advance the understanding of the goal and design principles of cortical visual processing, and thus, will support the rational design of advanced therapeutic modalities, such as neural prosthetics for loss of visual function.

Public Health Relevance

To guide action and support perception, visual information from the retina must be interpreted by calculations carried out in the brain. The proposed research aims to advance the understanding of the initial stages of these calculations: what they are, and how they are carried out. Successful completion of this research will thus support the rational design of advanced therapeutic modalities, such as neural prosthetics for patients with visual loss.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
5R01EY007977-22
Application #
8319326
Study Section
Central Visual Processing Study Section (CVP)
Program Officer
Steinmetz, Michael A
Project Start
1989-01-01
Project End
2014-08-31
Budget Start
2012-09-01
Budget End
2013-08-31
Support Year
22
Fiscal Year
2012
Total Cost
$391,079
Indirect Cost
$141,079
Name
Weill Medical College of Cornell University
Department
Neurology
Type
Schools of Medicine
DUNS #
060217502
City
New York
State
NY
Country
United States
Zip Code
10065
Aytekin, Murat; Victor, Jonathan D; Rucci, Michele (2014) The visual input to the retina during natural head-free fixation. J Neurosci 34:12701-15
Nichols, Zachary; Nirenberg, Sheila; Victor, Jonathan (2013) Interacting linear and nonlinear characteristics produce population coding asymmetries between ON and OFF cells in the retina. J Neurosci 33:14958-73
Zaidi, Qasim; Victor, Jonathan; McDermott, Josh et al. (2013) Perceptual spaces: mathematical structures to neural mechanisms. J Neurosci 33:17597-602
Victor, Jonathan D; Thengone, Daniel J; Conte, Mary M (2013) Perception of second- and third-order orientation signals and their interactions. J Vis 13:21
Kuang, Xutao; Poletti, Martina; Victor, Jonathan D et al. (2012) Temporal encoding of spatial information during active visual fixation. Curr Biol 22:510-4
Pandarinath, Chethan; Victor, Jonathan D; Nirenberg, Sheila (2010) Symmetry breakdown in the ON and OFF pathways of the retina at night: functional implications. J Neurosci 30:10006-14
Pandarinath, Chethan; Bomash, Illya; Victor, Jonathan D et al. (2010) A novel mechanism for switching a neural system from one state to another. Front Comput Neurosci 4:2
Hu, Qin; Victor, Jonathan D (2010) A set of high-order spatiotemporal stimuli that elicit motion and reverse-phi percepts. J Vis 10:9.1-16
Nirenberg, Sheila; Bomash, Illya; Pillow, Jonathan W et al. (2010) Heterogeneous response dynamics in retinal ganglion cells: the interplay of predictive coding and adaptation. J Neurophysiol 103:3184-94
Tkacik, Gasper; Prentice, Jason S; Victor, Jonathan D et al. (2010) Local statistics in natural scenes predict the saliency of synthetic textures. Proc Natl Acad Sci U S A 107:18149-54

Showing the most recent 10 out of 53 publications