Many of the investigations that are now carried out during imaging systems' evaluations and comparisons include interpretation (reading) studies of normal and abnormal cases that are evaluated by receiver operating characteristic analyses (ROC) or derivatives thereof. Unfortunately, limitations in present methodology for systems evaluations have results in extremely complicated and costly study designs and data methodology to apply a different formulation of a well- known statistic to this problem and verify the proposed approach using both simulation and a large set of experimental data available to us. The Wilcoxon statistic, a non-parametric method often used to obtain the area under the ROC curve when scoring data is used, has a formulation that compares all possible pairs of observations of a negative and a positive case. Although this conceptualization of the problem can be used to further develop and extend ROC methodology. We plan to exploit this conceptualization to develop a sensitive statistical test to compare the areas under two or more ROC curses in a manner that will enable us to assess the effect of selected variables on the area under the ROC curve as to summarize diagnostic accuracy in the multi-disease setting and to quality the difference in diagnostic accuracy of two modalities (or more) as a function of different parameters and possibly after the incorporation of utility function.

Agency
National Institute of Health (NIH)
Institute
National Cancer Institute (NCI)
Type
Research Project (R01)
Project #
2R01CA066594-08
Application #
6430055
Study Section
Diagnostic Imaging Study Section (DMG)
Program Officer
Croft, Barbara
Project Start
2002-05-01
Project End
2006-04-30
Budget Start
2002-05-01
Budget End
2003-04-30
Support Year
8
Fiscal Year
2002
Total Cost
$244,721
Indirect Cost
Name
University of Pittsburgh
Department
Radiation-Diagnostic/Oncology
Type
Schools of Medicine
DUNS #
053785812
City
Pittsburgh
State
PA
Country
United States
Zip Code
15213
Fuhrman, Carl R; Britton, Cynthia A; Bender, Thomas et al. (2002) Observer performance studies: detection of single versus multiple abnormalities of the chest. AJR Am J Roentgenol 179:1551-3
Rockette, H E; Li, W; Brown, M L et al. (2001) Statistical test to assess rank-order imaging studies. Acad Radiol 8:24-30
Swensson, R G; King, J L; Gur, D (2001) A constrained formulation for the receiver operating characteristic (ROC) curve based on probability summation. Med Phys 28:1597-609
Good, W F; Sumkin, J H; Ganott, M et al. (2000) Detection of masses and clustered microcalcifications on data compressed mammograms: an observer performance study. AJR Am J Roentgenol 175:1573-6
Swensson, R G (2000) Using localization data from image interpretations to improve estimates of performance accuracy. Med Decis Making 20:170-85
Swensson, R G; King, J L; Good, W F et al. (2000) Observer variation and the performance accuracy gained by averaging ratings of abnormality. Med Phys 27:1920-33
Towers, J D; Holbert, J M; Britton, C A et al. (2000) Multipoint rank-order study methodology: observer issues. Invest Radiol 35:125-30
Good, W F; Sumkin, J H; Dash, N et al. (1999) Observer sensitivity to small differences: a multipoint rank-order experiment. AJR Am J Roentgenol 173:275-8
Rockette, H E; King, J L; Thaete, F L et al. (1998) Selection of subtle cases for observer-performance studies: the importance of knowing the true diagnosis. Acad Radiol 5:86-92
Britton, C A; Gabriele, O F; Chang, T S et al. (1996) Subjective quality assessment of computed radiography hand images. J Digit Imaging 9:21-4

Showing the most recent 10 out of 11 publications