? ? Conventional ROC analysis has been widely accepted as a standard in the assessment of diagnostic techniques for binary diagnoses. Many medical diagnoses, however, involve multiple diagnostic alternatives. Examples are breast cancer diagnosis using mammography, where the diagnostic classes are normal, benign, or malignant tumor, and cardiac disease diagnosis using myocardial perfusion SPECT (MRS), where the classes are normal, reversible or fixed defect. To assess multi-class diagnostic techniques, multi-class ROC is required, but has remained an unsolved problem ever since the introduction of binary ROC analysis in the 1950s. Sparked by a practical challenge raised by MPS optimization, the candidate proposed a three- class ROC analysis method that extends and unifies the decision theoretic, linear discriminant analysis and probabilistic foundations of binary ROC in a three-class paradigm. She has conducted five preliminary studies on three-class ROC analysis: (1) deriving its decision model [He, Metz, et.al IEEE Trans Med Imag (TMI) vol. 25(5), 2006]; (2) investigating its decision theoretic foundation [He and Frey, TMI, vol. 25(8), 2006]; (3) exploring its linear discriminant analysis (LDA) foundation [He and Frey, TMI, in press, 2006]; (4) establishing its probabilistic foundation; and (5) comparing it with conventional three-class LDA and revealing the limitations of conventional three-class LDA. The candidate obtained a PhD in Biomedical Engineering in December 2005 and had intensive training on medical imaging. She increased her interest in medical image quality assessment during the development of three-class ROC analysis; her knowledge of the statistics and decision theory principals used in this research is self-taught. Further exploring new areas opened by three- class ROC analysis requires systematic understanding of the statistical principles in decision theory, statistical learning, and Bayesian modeling, etc. Thus, she requests a two-year mentored phase focusing on formal biostatistics training. The training phase will substantially enhance the candidate's career development as an interdisciplinary investigator and contribute to her independent research to accomplish the following specific aims: 1) to establish the theoretical foundations of three-class ROC analysis; (2) to develop general statistical methods for three-class ROC analysis; (3) to apply the three-class methodologies to task-based medical image quality assessment. The significance of the proposed work is two-fold. First, it provides a rigorous solution to an open theoretical problem and will open new areas of theoretical research in ROC analysis and medical decision making. Second, it enables applications of task-based assessment techniques for multi-class diagnosis. These techniques have the potential to fundamentally improve current imaging techniques for disease detection and characterization, and thus to enhance doctors' performance in disease diagnosis, which will broadly benefit public health. ? ? ?

Agency
National Institute of Health (NIH)
Institute
National Institute of Biomedical Imaging and Bioengineering (NIBIB)
Type
Career Transition Award (K99)
Project #
5K99EB007620-02
Application #
7480255
Study Section
Special Emphasis Panel (ZEB1-OSR-D (M1))
Program Officer
Erim, Zeynep
Project Start
2007-08-09
Project End
2009-07-31
Budget Start
2008-08-01
Budget End
2009-07-31
Support Year
2
Fiscal Year
2008
Total Cost
$89,733
Indirect Cost
Name
Johns Hopkins University
Department
Radiation-Diagnostic/Oncology
Type
Schools of Medicine
DUNS #
001910777
City
Baltimore
State
MD
Country
United States
Zip Code
21218
He, Xin; Gallas, Brandon D; Frey, Eric C (2010) Three-class ROC analysis--toward a general decision theoretic solution. IEEE Trans Med Imaging 29:206-15
He, Xin; Frey, Eric C (2009) The validity of three-class Hotelling trace (3-HT) in describing three-class task performance: comparison of three-class volume under ROC surface (VUS) and 3-HT. IEEE Trans Med Imaging 28:185-93
He, Xin; Frey, Eric (2009) ROC, LROC, FROC, AFROC: an alphabet soup. J Am Coll Radiol 6:652-5
He, Xin; Caffo, Brian S; Frey, Eric C (2008) Toward realistic and practical ideal observer (IO) estimation for the optimization of medical imaging systems. IEEE Trans Med Imaging 27:1535-43
He, Xin; Frey, Eric C (2008) The meaning and use of the volume under a three-class ROC surface (VUS). IEEE Trans Med Imaging 27:577-88
He, Xin; Song, Xiyun; Frey, Eric C (2008) Application of three-class ROC analysis to task-based image quality assessment of simultaneous dual-isotope myocardial perfusion SPECT (MPS). IEEE Trans Med Imaging 27:1556-67