Consider looking at a bone scan or a CT to determine if a patient is responding to cancer treatment. Or, as a less life-and-death case, consider searching through a child's toy box for all the Lego pieces that can be used to build a roof on today's project. These are complex, extended visual searches for multiple instances of multiple target types, be they metastases of cancer or building blocks of a particular shape. How do humans perform such tasks and how can we help experts to perform more effectively the critical extended search tasks that our civilization has created in the clinic, the airport, and elsewhere? The past 25+ years have seen great progress in understanding the basic process of visual selective attention. That said, the bulk of the existing work involves brief episodes of search (seconds) for a single instance of a single class of target (e.g. find a red vertical line or this specific object). Typically, that target will be present on 50% or more of trials. In order to understand and improve upon socially important search tasks in radiology and elsewhere, we must investigate extended visual search tasks. The proposed work exploits three extended search paradigms, largely new to the study of human search. Foraging tasks are laboratory analogs of picking berries in a field or lung nodules in a chest CT. Observers try to select as many target items as possible in a fixed period of time. To model this behavior, the Guided Search (GS) model is augmented with ideas from the literature on animal foraging as well as decision theory and neuroeconomics. Hybrid Search tasks involve searching visual displays for any of several possible types of target (think of a shopping list or a checklist of signs of disease). These are combinations of visual search and memory search. It is possible to search for literally hundreds of distinct objects, held in memory. To model this behavior, ideas from the study of working memory and long-term memory (LTM) are brought into the GS framework. Finally, Hybrid Foraging tasks combine the demands of the foraging and hybrid tasks. Here, observers attempt to collect as many examples as possible of multiple types of targets. We use each of these methods in laboratory studies with non-expert observers and in experiments with expert radiologists. We seek to describe and model the fundamental processes of extended search and to improve the ability of radiologists and other experts to perform such searches. Of particular interest are searches for rare, low prevalence targets (e.g. cancer in a breast cancer screening population appears in about 0.3% of exams). False negative, miss errors are elevated at low prevalence in clinical settings. The proposed work suggests techniques for ameliorating this effect and examines the impact of prevalence in extended search tasks. In summary, this work develops an interdisciplinary extension of GS, applied to extended search tasks, with the ultimate goal of improving performance on the critical search tasks found in radiology and other socially important settings.
From the radiology reading room to the airport security line, modern civilization creates difficult but important visual search tasks and asks experts to perform them swiftly and without error. Most laboratory research has examined searches that last about a second with the searcher looking for one instance of a single type of target, but many of the socially important tasks (for example, searching an abdominal CT for signs of metastatic cancer) are extended search tasks for multiple instances of multiple target types. With experiments using radiologists and non-experts as observers, we seek to improve the ability of experts to perform these extended search tasks.
|Wolfe, Jeremy M; Alaoui Soce, Abla; Schill, Hayden M (2017) How did I miss that? Developing mixed hybrid visual search as a 'model system' for incidental finding errors in radiology. Cogn Res Princ Implic 2:35|
|Cunningham, Corbin A; Drew, Trafton; Wolfe, Jeremy M (2017) Analog Computer-Aided Detection (CAD) information can be more effective than binary marks. Atten Percept Psychophys 79:679-690|
|Aizenman, Avi; Drew, Trafton; Ehinger, Krista A et al. (2017) Comparing search patterns in digital breast tomosynthesis and full-field digital mammography: an eye tracking study. J Med Imaging (Bellingham) 4:045501|
|Kok, Ellen M; Aizenman, Avi M; Võ, Melissa L-H et al. (2017) Even if I showed you where you looked, remembering where you just looked is hard. J Vis 17:2|
|Drew, Trafton; Boettcher, Sage E P; Wolfe, Jeremy M (2017) One visual search, many memory searches: An eye-tracking investigation of hybrid search. J Vis 17:5|
|Ehinger, Krista A; Allen, Kala; Wolfe, Jeremy M (2016) Change blindness for cast shadows in natural scenes: Even informative shadow changes are missed. Atten Percept Psychophys 78:978-87|
|Sareen, Preeti; Ehinger, Krista A; Wolfe, Jeremy M (2016) CB Database: A change blindness database for objects in natural indoor scenes. Behav Res Methods 48:1343-1348|
|Josephs, Emilie L; Draschkow, Dejan; Wolfe, Jeremy M et al. (2016) Gist in time: Scene semantics and structure enhance recall of searched objects. Acta Psychol (Amst) 169:100-108|
|Võ, Melissa L-H; Aizenman, Avigael M; Wolfe, Jeremy M (2016) You think you know where you looked? You better look again. J Exp Psychol Hum Percept Perform 42:1477-81|
|Evans, Karla K; Haygood, Tamara Miner; Cooper, Julie et al. (2016) A half-second glimpse often lets radiologists identify breast cancer cases even when viewing the mammogram of the opposite breast. Proc Natl Acad Sci U S A 113:10292-7|
Showing the most recent 10 out of 66 publications