Consider looking at a bone scan or a CT to determine if a patient is responding to cancer treatment. Or, as a less life-and-death case, consider searching through a child's toy box for all the Lego pieces that can be used to build a roof on today's project. These are complex, extended visual searches for multiple instances of multiple target types, be they metastases of cancer or building blocks of a particular shape. How do humans perform such tasks and how can we help experts to perform more effectively the critical extended search tasks that our civilization has created in the clinic, the airport, and elsewhere? The past 25+ years have seen great progress in understanding the basic process of visual selective attention. That said, the bulk of the existing work involves brief episodes of search (seconds) for a single instance of a single class of target (e.g. find a red vertical line or this specific object). Typically, that target will be present on 50% or more of trials. In order to understand and improve upon socially important search tasks in radiology and elsewhere, we must investigate extended visual search tasks. The proposed work exploits three extended search paradigms, largely new to the study of human search. Foraging tasks are laboratory analogs of picking berries in a field or lung nodules in a chest CT. Observers try to select as many target items as possible in a fixed period of time. To model this behavior, the Guided Search (GS) model is augmented with ideas from the literature on animal foraging as well as decision theory and neuroeconomics. Hybrid Search tasks involve searching visual displays for any of several possible types of target (think of a shopping list or a checklist of signs of disease). These are combinations of visual search and memory search. It is possible to search for literally hundreds of distinct objects, held in memory. To model this behavior, ideas from the study of working memory and long-term memory (LTM) are brought into the GS framework. Finally, Hybrid Foraging tasks combine the demands of the foraging and hybrid tasks. Here, observers attempt to collect as many examples as possible of multiple types of targets. We use each of these methods in laboratory studies with non-expert observers and in experiments with expert radiologists. We seek to describe and model the fundamental processes of extended search and to improve the ability of radiologists and other experts to perform such searches. Of particular interest are searches for rare, low prevalence targets (e.g. cancer in a breast cancer screening population appears in about 0.3% of exams). False negative, miss errors are elevated at low prevalence in clinical settings. The proposed work suggests techniques for ameliorating this effect and examines the impact of prevalence in extended search tasks. In summary, this work develops an interdisciplinary extension of GS, applied to extended search tasks, with the ultimate goal of improving performance on the critical search tasks found in radiology and other socially important settings.

Public Health Relevance

From the radiology reading room to the airport security line, modern civilization creates difficult but important visual search tasks and asks experts to perform them swiftly and without error. Most laboratory research has examined searches that last about a second with the searcher looking for one instance of a single type of target, but many of the socially important tasks (for example, searching an abdominal CT for signs of metastatic cancer) are extended search tasks for multiple instances of multiple target types. With experiments using radiologists and non-experts as observers, we seek to improve the ability of experts to perform these extended search tasks.

Agency
National Institute of Health (NIH)
Institute
National Eye Institute (NEI)
Type
Research Project (R01)
Project #
2R01EY017001-08
Application #
8631282
Study Section
Cognition and Perception Study Section (CP)
Program Officer
Wiggs, Cheri
Project Start
2005-12-01
Project End
2017-04-30
Budget Start
2014-05-01
Budget End
2015-04-30
Support Year
8
Fiscal Year
2014
Total Cost
Indirect Cost
Name
Brigham and Women's Hospital
Department
Type
DUNS #
City
Boston
State
MA
Country
United States
Zip Code
02115
Drew, Trafton; Boettcher, Sage E P; Wolfe, Jeremy M (2016) Searching while loaded: Visual working memory does not interfere with hybrid search efficiency but hybrid search uses working memory capacity. Psychon Bull Rev 23:201-12
Josephs, Emilie L; Draschkow, Dejan; Wolfe, Jeremy M et al. (2016) Gist in time: Scene semantics and structure enhance recall of searched objects. Acta Psychol (Amst) 169:100-8
Josephs, Emilie; Drew, Trafton; Wolfe, Jeremy (2016) Shuffling your way out of change blindness. Psychon Bull Rev 23:193-200
Wen, Gezheng; Aizenman, Avigael; Drew, Trafton et al. (2016) Computational assessment of visual search strategies in volumetric medical images. J Med Imaging (Bellingham) 3:015501
Ehinger, Krista A; Allen, Kala; Wolfe, Jeremy M (2016) Change blindness for cast shadows in natural scenes: Even informative shadow changes are missed. Atten Percept Psychophys 78:978-87
Drew, Trafton; Aizenman, Avi M; Thompson, Matthew B et al. (2016) Image toggling saves time in mammography. J Med Imaging (Bellingham) 3:011003
Ehinger, Krista A; Wolfe, Jeremy M (2016) When is it time to move to the next map? Optimal foraging in guided visual search. Atten Percept Psychophys 78:2135-51
Evans, Karla K; Haygood, Tamara Miner; Cooper, Julie et al. (2016) A half-second glimpse often lets radiologists identify breast cancer cases even when viewing the mammogram of the opposite breast. Proc Natl Acad Sci U S A 113:10292-7
Võ, Melissa L-H; Aizenman, Avigael M; Wolfe, Jeremy M (2016) You think you know where you looked? You better look again. J Exp Psychol Hum Percept Perform 42:1477-81
Wolfe, Jeremy M; Aizenman, Avigael M; Boettcher, Sage E P et al. (2016) Hybrid foraging search: Searching for multiple instances of multiple types of target. Vision Res 119:50-9

Showing the most recent 10 out of 56 publications