In our daily lives, we search for our keys, look for a friend in a crowd, and try to find a button on our remote control. Visual search is an important part of many applications, as well, including search for a possible tumor in a mammogram, or search for a threat in a baggage x-ray. Search has been studied intensely for 30 years, but the results remain puzzling. Some searches are easy, even when the target appears against a background of many "distractor" items. Other searches become quite difficult with many distractors, even when the target and distractors are quite distinct. We lack a computational model that can predict which searches will be easy or hard, or make quantitative predictions of search performance for arbitrary displays. The overall goal of the proposed research is to better understand visual search based on the insight that the capabilities of peripheral vision provide a fundamental constraint on search performance. Peripheral vision enables fast target detection in the periphery (the target seems to "pop out"), and guides eye movements until, ultimately, the observer finds the target. The proposed work builds on recent modeling of peripheral vision. These recent results suggest that peripheral vision processes not individual items, but rather sizable local "patches," which it represents in terms of a rich set of summary statistics (Balas, Nakano, &Rosenholtz, 2009). The proposed research has two intertwined aims.
Aim 1 is to develop and test models of visual search based on the hypothesis that search is constrained by the discriminability of peripheral patches containing a target (and a number of distractors), and those containing only distractors. In particular, Dr. Rosenholtz will examine the extent to which search performance can be predicted by: Peripheral discriminability of (1) individual items (2) larger, crowded patches. (3) Predicted discriminability of target present vs. target absent patches based upon their summary statistic representation;(4) A quantitative model of the fixations required to find a target.
Aim 2 is to test whether a wide range of search phenomena can be accounted for by a single mechanism of peripheral vision. In particular, Dr. Rosenholtz will examine: (1) The predominance of search asymmetries, e.g. that it is easier to search for a 'Q'among 'O's than for an 'O'among 'Q's;(2) Differences between search for a target differing from distractors by a single feature, by a conjunction of features, and by a configuration of basic features;(3) Somewhat puzzling accounts of what constitutes a "basic feature" that can guide search;(4) The effects of grouping on visual search.

Public Health Relevance

Visual search is a near-ubiquitous task in our daily lives, and understanding it will clarify more generally the processes by which we constantly move our eyes to piece together information about the world. In addition, understanding visual search will elucidate representations and performance of normal human vision. Successfully modeling visual search will shed light on important search tasks such as finding a tumor in a mammogram, and will enable improved design of low-vision aids for older adults and the visually-impaired.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
5R01EY021473-02
Application #
8511658
Study Section
Central Visual Processing Study Section (CVP)
Program Officer
Wiggs, Cheri
Project Start
2012-08-01
Project End
2015-07-31
Budget Start
2013-08-01
Budget End
2014-07-31
Support Year
2
Fiscal Year
2013
Total Cost
$300,929
Indirect Cost
$110,929
Name
Massachusetts Institute of Technology
Department
Other Basic Sciences
Type
Schools of Arts and Sciences
DUNS #
001425594
City
Cambridge
State
MA
Country
United States
Zip Code
02139
Akkaynak, Derya (2014) Use of spectroscopy for assessment of color discrimination in animal vision. J Opt Soc Am A Opt Image Sci Vis 31:A27-33