New diagnostic tools developed for the non-invasive diagnosis of serious illnesses require evaluation and should be compared against standard diagnostic tools. Receiver operating characteristic (ROC) analysis has become established as the appropriate method for such comparisons and much of the research has been focused on comparing the areas under the ROC curves. The general purpose of this proposal is to extend a distribution-free permutation test procedure that compares entire ROC curves for two diagnostic tests based on continuous data from a paired design. The novelty of this new approach is that it permits a valid comparison of the tests without any assumptions other than that the pairs of observations are independent and identically distributed within disease status. Specifically we will develop asymptotic expressions to allow easier computation of the significance level of the proposed test statistic which is currently accomplished by resampling. We will generalize the test statistic to the unpaired data case, derive the appropriate resampling scheme for the evaluation of the significance level as well as an asymptotic expression for it, and study its properties. We will extend the methods for comparing diagnostic tests to the setting in which the results are in a rating scale (for example radiologic data) and study the effect of the models-used to generate the ROC curve from the discrete points on the rating scale. Finally, we will develop methods for adjusting for covariates that affect the performance of the diagnostic tests.

Agency
National Institute of Health (NIH)
Institute
National Cancer Institute (NCI)
Type
First Independent Research Support & Transition (FIRST) Awards (R29)
Project #
5R29CA073848-05
Application #
6376373
Study Section
Special Emphasis Panel (ZRG7-STA (01))
Program Officer
Erickson, Burdette (BUD) W
Project Start
1997-04-01
Project End
2003-03-31
Budget Start
2001-04-01
Budget End
2003-03-31
Support Year
5
Fiscal Year
2001
Total Cost
$117,876
Indirect Cost
Name
Sloan-Kettering Institute for Cancer Research
Department
Type
DUNS #
064931884
City
New York
State
NY
Country
United States
Zip Code
10065
Olshen, Adam B; Venkatraman, E S; Lucito, Robert et al. (2004) Circular binary segmentation for the analysis of array-based DNA copy number data. Biostatistics 5:557-72
Satagopan, Jaya M; Venkatraman, E S; Begg, Colin B (2004) Two-stage designs for gene-disease association studies with sample size constraints. Biometrics 60:589-97
Satagopan, Jaya M; Verbel, David A; Venkatraman, E S et al. (2002) Two-stage designs for gene-disease association studies. Biometrics 58:163-70
Venkatraman, E S (2000) A permutation test to compare receiver operating characteristic curves. Biometrics 56:1134-8
Begg, C B; Cramer, L D; Venkatraman, E S et al. (2000) Comparing tumour staging and grading systems: a case study and a review of the issues, using thymoma as a model. Stat Med 19:1997-2014
Venkatraman, E S; Begg, C B (1999) Properties of a nonparametric test for early comparison of treatments in clinical trials in the presence of surrogate endpoints. Biometrics 55:1171-6