Modern civilization asks trained experts to perform a range of critical visual search tasks such as satellite image interpretation, airport baggage screening, and quality monitoring in manufacturing. In medicine, visual search through complex medical images is critical to detection and diagnosis of disease (e.g. screening for breast or lung cancer, evaluation of stroke, detection of internal injuries after trauma). The important search tasks of modern civilization are quite varied but they share significant characteristics. They are demanding tasks, carried out by experts who are asked to perform with high accuracy. Very significant resources are devoted to these tasks and very substantial costs accompany errors. These are quite literally matters of life and death. Nevertheless, committed professionals do not perform those tasks as well as would be desired or expected. Why are their error rates as high as they are? Search tasks are not new. Animals have always searched for food and mates. This proposal tests the hypothesis that the processes of search that served us well as visual foragers in the natural world may not serve as well when we search for tumors or fractures. Errors can arise when natural mechanisms of search meet the artificial demands of medical image perception. Errors can be reduced by developing and applying an understanding of the human search engine. Our basic research strategy is to bring problems from the clinical setting into the lab where they can be extensively studied in non-expert populations and then to use those basic research results to generate highly focused hypotheses that can be tested in the clinical setting. There are three specific aims: 1) Many modern medical imaging devices create 3D volumes of data (e.g. CT and MRI).
Aim 1 tests the hypothesis that the presentation of 3D data changes the sources of errors in medical image perception (e.g. by increasing the chance that a specific region of a 3D dataset will not be attended). 2) Many medical image perception tasks are "foraging" tasks where observers searching for multiple targets in displays extended in time and space. Foraging has been a topic of interest in the animal behavior literature but only minimally in the human visual search literature. When is it time to stop foraging and move on? Aim 2 tests the hypothesis that the foraging rules that work in the natural world may be a source of errors in the clinic. 3) The third aim is to fuse models of visual search and models of medical image perception into a more comprehensive model. Search models from the lab have dealt with search tasks that last for about a second. Medical image perception models are concerned with tasks that last for minutes or more.
Aim 3 tests the hypothesis that basic search models can be extended to this longer time frame with changes that will be constrained by the research proposed here.

Public Health Relevance

Errors in medical image perception tasks like screening for breast cancer are distressingly high. In a substantial proportion of cases, the sign of disease is visible but, nevertheless, missed by a well-intentioned, well-trained expert. Since humans will be performing these tasks for the foreseeable future, the goal of this research is to understand the perceptual and attentional factors that produce these errors so that counter-measures can be devised to prevent them.

National Institute of Health (NIH)
National Eye Institute (NEI)
Research Project (R01)
Project #
Application #
Study Section
Cognition and Perception Study Section (CP)
Program Officer
Wiggs, Cheri
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Brigham and Women's Hospital
United States
Zip Code
Sareen, Preeti; Ehinger, Krista A; Wolfe, Jeremy M (2015) Through the looking-glass: Objects in the mirror are less real. Psychon Bull Rev 22:980-6
Wolfe, Jeremy M (2014) Introduction to the special issue on visual working memory. Atten Percept Psychophys 76:1861-70
Brand, John; Oriet, Chris; Johnson, Aaron P et al. (2014) Flexible cue combination in the guidance of attention in visual search. Acta Psychol (Amst) 153:129-38
Drew, Trafton; Sherman, Ashley; Boettcher, Sage E P et al. (2014) Memory search for the first target modulates the magnitude of the attentional blink. Mem Cognit 42:1333-44
Cunningham, Corbin A; Wolfe, Jeremy M (2014) The role of object categories in hybrid visual and memory search. J Exp Psychol Gen 143:1585-99
Evans, Karla K; Georgian-Smith, Diane; Tambouret, Rosemary et al. (2013) The gist of the abnormal: above-chance medical decision making in the blink of an eye. Psychon Bull Rev 20:1170-5
Drew, Trafton; Vo, Melissa Le-Hoa; Olwal, Alex et al. (2013) Scanners and drillers: characterizing expert visual search through volumetric images. J Vis 13:
Vo, Melissa L-H; Wolfe, Jeremy M (2013) The interplay of episodic and semantic memory in guiding repeated search in scenes. Cognition 126:198-212
Wolfe, Jeremy M (2013) When is it time to move to the next raspberry bush? Foraging rules in human visual search. J Vis 13:10
Wolfe, Jeremy M; Brunelli, David N; Rubinstein, Joshua et al. (2013) Prevalence effects in newly trained airport checkpoint screeners: trained observers miss rare targets, too. J Vis 13:33

Showing the most recent 10 out of 27 publications