The power of the human visual system derives in large part from the ability of its perceptual grouping mechanisms to find structure and organization in the images encoded by the retinas. We propose to continue and extend our general quantitative approach to understanding the mechanisms of perceptual grouping. Our approach consists of: (1) measuring the statistical properties of natural images that are relevant for perceptual grouping, (2) developing models of perceptual grouping that are informed by the statistical properties of natural images, by the physiology and psychophysics of low-level vision, and by computational principles, and (3) testing the predictions of these models and competing models in human psychophysical experiments. We propose to measure natural scene statistics for image contours and regions using two methods. One involves measuring local features in images and then computing simple co- occurrence statistics, i.e., the joint probabilities of different possible feature values. The other involves hand segmenting images, measuring local features in the images, and then computing co-occurrence statistics that are conditional on the segmentation. These statistics, especially the conditional statistics, will be used to generate Bayesian models for contour and region grouping. In preliminary studies, we discovered a number of robust statistical properties of natural images and have begun developing models of perceptual grouping where those properties are exploited in an optimal (rational) fashion. A number of contour grouping and region grouping experiments are proposed to test these models. We have made good progress with this general approach during previous project period. This work is important because understanding the physics of natural stimuli is essential for understanding natural (real) perceptual tasks and just about every design aspect of the visual system, and because perceptual grouping mechanisms play a central role in all higher order visual functions including form, shape, object and scene perception. Of note are studies that will provide the first detailed measurements of contour and region statistics of close-up foliage, which is of particular relevance for studies of visual mechanisms in the monkey. Also of note are studies of the role of peripheral vision and eye movements in natural tasks. Understanding these capabilities is crucial for understanding the effects of low vision on visual performance and how best to mitigate those effects. ? ? ?
Showing the most recent 10 out of 34 publications
