This project consists of a set of inter-related experimental, computational, and theoretical studies, whose goal is to advance the understanding of the design principles of visual processing, and how these design principles are reduced to computations that can be carried out by neurons and neural circuitry. The many successes of ?normative theories? constitute our starting point: for example, how a sensory system's limited capacity should be deployed to effectively represent and transmit task-relevant information about its inputs. However, here we recognize that along with these successes ? in our lab and many others -- there are many divergences between normative predictions and what the visual system actually does. These discrepancies indicate that there are important constraints not recognized by current normative theories, such as limits to the detail with which natural-image priors are used. We focus on the extraction of figure from ground: this is a computationally-challenging process that is centrally important to visual function, and it also has a number of characteristics that we can use to advantage, building on recent advances in our lab. Distinguishing figure from ground is a fundamentally statistical process, so understanding how the visual system processes local image statistics is critical. In previous years, we developed a theoretical and experimental framework for this: we showed how luminance, contrast, orientation, and shape could be dissociated via the construction of a space of synthetic textures, and we then used this space to measure human visual sensitivity to these components individually and in combination and to analyze its relationship with natural-image statistics.
Aim 1 consists of psychophysical experiments to characterize three key aspects of figure-ground processing:
Aim 1 A, the influence of the statistics of figure, ground, and figure-ground differences, Aim 1B, the influence of figure shape, and Aim 1C, the influence of task-specific knowledge.
Aim 2 is motivated by models that formalize the hypothesis that visual computations make use of simplified Gaussian approximations to natural image statistics. To test these models, Aim 2A consists of computational studies to determine the statistics of image patches in figure and ground.
Aim 2 B makes further psychophysical measures that will determine a phenomenological model. Comparison of the phenomenological model and normative models built from natural-image statistics will proceed in stages: does the phenomenological model have the form predicted by normative theories (i.e., do measured threshold surfaces have the predicted shape)?I f so, what is the level of detail of natural-image priors that are needed to account, quantitatively, for perceptual thresholds? Successful completion of this research is expected to provide both specific and generalizable insights into principles of sensory processing, which in turn will provide the groundwork for advanced neural prosthetics and assistive devices.
(Public Health Relevance) To guide action and support perception, visual information from the retina must be interpreted by neural computations carried out in the brain. The proposed research aims to advance the understanding of this process, with a focus on how the brain reduces potentially intractable computational problems into algorithms that can be carried out with neural hardware. Successful completion of this research will provide infrastructure for the rational design of advanced neural prosthetics for patients with visual loss, and of machine vision algorithms that have the potential to improve medical diagnosis and provide more effective assistive devices.
| Rucci, Michele; Victor, Jonathan D (2018) Perspective: Can eye movements contribute to emmetropization? J Vis 18:10 |
| Victor, Jonathan D; Conte, Mary M; Chubb, Charles F (2017) Textures as Probes of Visual Processing. Annu Rev Vis Sci 3:275-296 |
| Boi, Marco; Poletti, Martina; Victor, Jonathan D et al. (2017) Consequences of the Oculomotor Cycle for the Dynamics of Perception. Curr Biol 27:1268-1277 |
| Victor, Jonathan D; Rizvi, Syed M; Conte, Mary M (2017) Two representations of a high-dimensional perceptual space. Vision Res 137:1-23 |
| Joukes, Jeroen; Yu, Yunguo; Victor, Jonathan D et al. (2017) Recurrent Network Dynamics; a Link between Form and Motion. Front Syst Neurosci 11:12 |
| Hu, Qin; Victor, Jonathan D (2016) Two-Dimensional Hermite Filters Simplify the Description of High-Order Statistics of Natural Images. Symmetry (Basel) 8: |
| Nitzany, Eyal I; Loe, Maren E; Palmer, Stephanie E et al. (2016) Perceptual interaction of local motion signals. J Vis 16:22 |
| Victor, Jonathan D; Thengone, Daniel J; Rizvi, Syed M et al. (2015) A perceptual space of local image statistics. Vision Res 117:117-35 |
| Rucci, Michele; Victor, Jonathan D (2015) The unsteady eye: an information-processing stage, not a bug. Trends Neurosci 38:195-206 |
| Menda, Gil; Shamble, Paul S; Nitzany, Eyal I et al. (2014) Visual perception in the brain of a jumping spider. Curr Biol 24:2580-5 |
Showing the most recent 10 out of 69 publications
