The different geometric position of left and right eye leads to small differences between the images on the two retinae. The disparity of the images is used by the visual system to infer depth. A central challenge consists in identifying corresponding features in the two eyes called the stereo correspondence problem. Visual neurons suffer from the problem that responses to non-corresponding images (false matches) can be as large as those to correct matches. The disparity-energy model has been widely used to explain the disparity tuning of neurons in the primary visual cortex (V1). This model passes the image through linear filters in each eye, and then passes the binocular sum through an output nonlinearity. It is a member of a widely used class of linear-nonlinear (LN) models. The original disparity-energy model placed strong constraints on the linear filters: there were exactly two parallel elements (a quadrature pair), both of which are excitatory. Both elements used the same rule (e.g. a simple translation) to apply a disparity between left and right eye filters a receptive field (RF) disparity. These two elements elegantly capture many properties of disparity selective neurons. However, such a simple model is inevitably an approximation understanding how real neurons deviate from this approximation has helped clarify how they compute disparity. The energy model responds best (on average) to stimuli with a disparity that matches the RF disparity. Nonetheless (as with many other detectors), in any one image, stronger activation may be produced by a disparity that does not match. This means that the particular image projected on one models RFs might lead to a stronger response in another model neuron with a different RF disparity. It is therefore unclear how the correct depth can be inferred from a population of such neurons. Work performed under this project in previous years has suggested that responses to false matches may be attenuated by adding elements to the original model. In order to characterize these putative elements with as few assumptions as possible, we analyzed the spiking responses of neurons in the primate V1 with a spike-triggered covariance approach. This revealed that neuronal responses are characterized by a combination of both excitatory and inhibitory elements. Furthermore, the elements'filters are arranged in a way that results in a suppression of neuronal responses to false matches. We showed that this combination of excitatory and suppressive elements helps to reduce the problem of false matches in the stereo correspondence problem.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Investigator-Initiated Intramural Research Projects (ZIA)
Project #
1ZIAEY000404-09
Application #
8149163
Study Section
Project Start
Project End
Budget Start
Budget End
Support Year
9
Fiscal Year
2010
Total Cost
$936,491
Indirect Cost
Name
U.S. National Eye Institute
Department
Type
DUNS #
City
State
Country
Zip Code
Quaia, Christian; Optican, Lance M; Cumming, Bruce G (2018) Binocular summation for reflexive eye movements. J Vis 18:7
Seemiller, Eric S; Cumming, Bruce G; Candy, T Rowan (2018) Human infants can generate vergence responses to retinal disparity by 5 to 10 weeks of age. J Vis 18:17
Quaia, Christian; Optican, Lance M; Cumming, Bruce G (2017) Suppression and Contrast Normalization in Motion Processing. J Neurosci 37:11051-11066
Quaia, Christian; Optican, Lance M; Cumming, Bruce G (2017) Combining 1-D components to extract pattern information: It is about more than component similarity. J Vis 17:21
Tarawneh, Ghaith; Nityananda, Vivek; Rosner, Ronny et al. (2017) Invisible noise obscures visible signal in insect motion detection. Sci Rep 7:3496
Clery, Stephane; Cumming, Bruce G; Nienborg, Hendrikje (2017) Decision-Related Activity in Macaque V2 for Fine Disparity Discrimination Is Not Compatible with Optimal Linear Readout. J Neurosci 37:715-725
Joiner, Wilsaan M; Cavanaugh, James; Wurtz, Robert H et al. (2017) Visual Responses in FEF, Unlike V1, Primarily Reflect When the Visual Context Renders a Receptive Field Salient. J Neurosci 37:9871-9879
Read, Jenny C A; Cumming, Bruce G (2017) Visual Perception: Neural Networks for Stereopsis. Curr Biol 27:R594-R596
Henriksen, Sid; Tanabe, Seiji; Cumming, Bruce (2016) Disparity processing in primary visual cortex. Philos Trans R Soc Lond B Biol Sci 371:
Quaia, Christian; Optican, Lance M; Cumming, Bruce G (2016) A Motion-from-Form Mechanism Contributes to Extracting Pattern Motion from Plaids. J Neurosci 36:3903-18

Showing the most recent 10 out of 36 publications