Many of the investigations that are now carried out during imaging systems' evaluations and comparisons include interpretation (reading) studies of normal and abnormal cases that are evaluated by receiver operating characteristics (ROC) or derivatives thereof. ROC methodology (as well as its derivatives) has many limitations that are rarely considered when imaging systems' evaluations are proposed. It is the purpose of this investigation to explore alternative methodologies and compare their results to those obtained using a point measurement ROC methodology for similar assessments. The different methodologies could potentially be used to derive conclusive results, or alternatively, they can be used to define the range of the variable of interest that should be further investigated using an ROC-type study. To do so, we will explore a variety of scenarios where the images produced by the systems are either similar and/or different. The methodologies we will explore are both non-prompted and prompted subjective ratings, Just Noticeable Differences (JND), and multi-point rank ordering.

Agency
National Institute of Health (NIH)
Institute
National Cancer Institute (NCI)
Type
Research Project (R01)
Project #
1R01CA066594-01
Application #
2110007
Study Section
Special Emphasis Panel (ZRG7-SSS-X (41))
Project Start
1995-04-10
Project End
2000-03-31
Budget Start
1995-04-10
Budget End
1996-03-31
Support Year
1
Fiscal Year
1995
Total Cost
Indirect Cost
Name
University of Pittsburgh
Department
Radiation-Diagnostic/Oncology
Type
Schools of Medicine
DUNS #
053785812
City
Pittsburgh
State
PA
Country
United States
Zip Code
15213
Fuhrman, Carl R; Britton, Cynthia A; Bender, Thomas et al. (2002) Observer performance studies: detection of single versus multiple abnormalities of the chest. AJR Am J Roentgenol 179:1551-3
Rockette, H E; Li, W; Brown, M L et al. (2001) Statistical test to assess rank-order imaging studies. Acad Radiol 8:24-30
Swensson, R G; King, J L; Gur, D (2001) A constrained formulation for the receiver operating characteristic (ROC) curve based on probability summation. Med Phys 28:1597-609
Swensson, R G; King, J L; Good, W F et al. (2000) Observer variation and the performance accuracy gained by averaging ratings of abnormality. Med Phys 27:1920-33
Towers, J D; Holbert, J M; Britton, C A et al. (2000) Multipoint rank-order study methodology: observer issues. Invest Radiol 35:125-30
Good, W F; Sumkin, J H; Ganott, M et al. (2000) Detection of masses and clustered microcalcifications on data compressed mammograms: an observer performance study. AJR Am J Roentgenol 175:1573-6
Swensson, R G (2000) Using localization data from image interpretations to improve estimates of performance accuracy. Med Decis Making 20:170-85
Good, W F; Sumkin, J H; Dash, N et al. (1999) Observer sensitivity to small differences: a multipoint rank-order experiment. AJR Am J Roentgenol 173:275-8
Rockette, H E; King, J L; Thaete, F L et al. (1998) Selection of subtle cases for observer-performance studies: the importance of knowing the true diagnosis. Acad Radiol 5:86-92
Britton, C A; Gabriele, O F; Chang, T S et al. (1996) Subjective quality assessment of computed radiography hand images. J Digit Imaging 9:21-4

Showing the most recent 10 out of 11 publications