Many of the investigations that are now carried out during imaging systems' evaluations and comparisons include interpretation (reading) studies of normal and abnormal cases that are evaluated by receiver operating characteristics (ROC) or derivatives thereof. Unfortunately, if one takes into account case and reader representativeness, most studies would require prohibitively large sample sizes and a large number of readers in order to produce adequate statistical power for a statistically significant discrimination between reading nodes in a manner that is both clinically relevant and generalizable. Approaches to case and observer selection protocols for these studies in this field have been largely arbitrary (and frequently suboptimal). The applicants propose to investigate the possibility that the implementation of specific case and reader selection protocols could allow one to focus on limited clinical questions that can be conclusively answered with an observer performance study while requiring a small effort; hence, making such studies much more feasible and reasonable to perform. During the prior effort, the applicants reported focusing their investigation on case selection issues. While they proposed to continue to investigate several aspects in this regard, the current proposal would focus on the possible effects of observer (reader) selection and training on study design and results.

National Institute of Health (NIH)
National Cancer Institute (NCI)
Research Project (R01)
Project #
Application #
Study Section
Diagnostic Imaging Study Section (DMG)
Program Officer
Croft, Barbara
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of Pittsburgh
Schools of Medicine
United States
Zip Code
Hardesty, Lara A; Ganott, Marie A; Hakim, Christiane M et al. (2005) ""Memory effect"" in observer performance studies of mammograms. Acad Radiol 12:286-90
Klym, Amy H; King, Jill L; Hardesty, Lara (2004) The effect of routine use of a computer-aided detection system on the practice of breast imagers: a subjective assessment. Acad Radiol 11:711-3
Gur, David; Sumkin, Jules H; Rockette, Howard E et al. (2004) Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system. J Natl Cancer Inst 96:185-90
Gur, David; Sumkin, Jules H; Hardesty, Lara A et al. (2004) Recall and detection rates in screening mammography. Cancer 100:1590-4
Mello-Thoms, Claudia (2003) Perception of breast cancer: eye-position analysis of mammogram interpretation. Acad Radiol 10:4-12
Mello-Thoms, Claudia; Dunn, Stanley M; Nodine, Calvin F et al. (2003) The perception of breast cancers--a spatial frequency analysis of what differentiates missed from reported cancers. IEEE Trans Med Imaging 22:1297-306
Mello-Thoms, Claudia; Dunn, Stanley; Nodine, Calvin F et al. (2002) The perception of breast cancer: what differentiates missed from reported cancers in mammography? Acad Radiol 9:1004-12
Fuhrman, Carl R; Britton, Cynthia A; Bender, Thomas et al. (2002) Observer performance studies: detection of single versus multiple abnormalities of the chest. AJR Am J Roentgenol 179:1551-3
Rockette, H E; Li, W; Brown, M L et al. (2001) Statistical test to assess rank-order imaging studies. Acad Radiol 8:24-30
Good, W F; Sumkin, J H; Ganott, M et al. (2000) Detection of masses and clustered microcalcifications on data compressed mammograms: an observer performance study. AJR Am J Roentgenol 175:1573-6

Showing the most recent 10 out of 16 publications