An integrated probabilistic framework for shape and surface interpretation Jacob Feldman and Manish Singh, Rutgers University The representation of visual shape is one of the central problems of perception, influencing many aspects of object recognition and scene understanding. But a comprehensive and principled account of how the human brain computes shape representationsdoes not yet exists. A key difficulty is in understanding how the brain divides the image into distinct surfaces at distinct depths, interprets the 3D shape of each surface, and divides each shape into distinct parts. In previous work the PIs have developed novel, principled mathematical methods for understanding human shape representation, based around the idea of Bayesian estimation of the shape skeleton. The shape skeleton is a representation of the axial structure of the shape, related to though different from classical medial axis representations. Medial axis representations break shapes down into their component axes, about which the shape is approximately locally symmetric. The PI's approach recasts this as a probabilistic inference problem, consistent with most contemporary neurocompuational modeling, but unlike most other computational models of shape. This allows the approach to be expanded in scope, encompassing the broader problem of the decomposition of the image into distinct surfaces and the interpretation of 3D shape. The approach is theoretically unified, and is mathematically suitable to be implemented in a parallel computational architecture, making it plausible as a model of neural shape coding.
The aim of this research program is to fully develop shape representation as a probabilistic es- timation problem, and test the many empirical predictions that emanate from this framework.
Specific aims i nclude expanding and testing the probabilistic approach to shape representation, and generalizing it to critical related problems, including figure/ground interpretation and 3D shape. This expansion will make it possible to fully integrate shape representation with the comprehension of surfaces in the visual image, in a coherent mathematical framework consistent with what is known about computation in visual cortex.

Public Health Relevance

This project involves empirical studies of critical functions of the human visual system, including the interpretation of visual shapes and surfaces. The research contributes to a foundational understanding of the human nervous system, thus helping us achieve better functional understanding of the mechanisms of disease in perceptual dysfunctions and cognitive deficits.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
1R01EY021494-01A1
Application #
8186864
Study Section
Cognition and Perception Study Section (CP)
Program Officer
Wiggs, Cheri
Project Start
2011-09-01
Project End
2015-08-31
Budget Start
2011-09-01
Budget End
2012-08-31
Support Year
1
Fiscal Year
2011
Total Cost
$294,099
Indirect Cost
Name
Rutgers University
Department
Psychology
Type
Schools of Arts and Sciences
DUNS #
001912864
City
New Brunswick
State
NJ
Country
United States
Zip Code
08901
Feldman, Jacob (2016) The simplicity principle in perception and cognition. Wiley Interdiscip Rev Cogn Sci 7:330-40
Tanrikulu, Ömer Daglar; Froyen, Vicky; Feldman, Jacob et al. (2016) Geometric figure-ground cues override standard depth from accretion-deletion. J Vis 16:15
Denisova, Kristina; Feldman, Jacob; Su, Xiaotao et al. (2016) Investigating shape representation using sensitivity to part- and axis-based transformations. Vision Res 126:347-361
Jäkel, Frank; Singh, Manish; Wichmann, Felix A et al. (2016) An overview of quantitative approaches in Gestalt perception. Vision Res 126:3-8
Froyen, Vicky; Feldman, Jacob; Singh, Manish (2015) Bayesian hierarchical grouping: Perceptual grouping as mixture estimation. Psychol Rev 122:575-97
Wilder, John; Feldman, Jacob; Singh, Manish (2015) Contour complexity and contour detection. J Vis 15:6
Cholewiak, Steven A; Fleming, Roland W; Singh, Manish (2015) Perception of physical stability and center of mass of 3-D objects. J Vis 15:
Kim, Sung-Ho; Feldman, Jacob; Singh, Manish (2013) Perceived causality can alter the perceived trajectory of apparent motion. Psychol Sci 24:575-82
Cholewiak, Steven A; Fleming, Roland W; Singh, Manish (2013) Visual perception of the physical stability of asymmetric three-dimensional objects. J Vis 13:12
Froyen, Vicky; Feldman, Jacob; Singh, Manish (2013) Rotating columns: relating structure-from-motion, accretion/deletion, and figure/ground. J Vis 13:

Showing the most recent 10 out of 17 publications