Markers for treatment selection have the potential to improve patient outcomes and decrease medical costs. When a treatment benefits only a subset of patients, a marker that identifies these subjects could be used to spare others unnecessary treatment. If a therapy is particularly harmful to certain individuals, a useful marker would identify these subjects to avoid treating them. New technologies are producing an abundance of candidate markers. However, the standards for their evaluation, which are essential for making decisions regarding marker advancement and regulatory approval, are sorely lacking. This application proposes to contribute to the development of these standards.
Aim 1 ("Measures of Performance") demonstrates the inadequacy of the current approach to evaluating treatment selection markers, and develops three novel statistical measures of marker performance: (i) Marker-by-treatment predictiveness curves display the treatment effect at each marker value;ii) Treatment selection ROC curves show the accuracy with which the marker discriminates between individuals who do and do not benefit from treatment;and iii) The selection impact curve describes the population impact of using the marker to select treatment.
Aim 2 ("Comparing Markers") builds on this approach to develop methods for comparing the performance of two candidate markers. Comparisons at fixed and optimized marker thresholds, as well as global summaries of marker performance, are proposed.
Aim 3 ("Covariate-Specific Performance") develops an approach to evaluating how marker performance varies with factors such as patient characteristics or aspects of the marker measurement procedure. Because marker combinations are commonly sought with the hopes of improving performance, Aim 4 ("Combining Markers") develops an approach to combining multiple markers and evaluating the performance of the combination. This also leads to a method for assessing the increment in performance gained by adding a new marker to existing markers or clinical information.
Aim 5 ("Study Design") considers the implications of these new methods for study design. While the ideal design is a blinded and randomized trial where the marker is measured at baseline on all participants, careful selection of a subset of trial subjects in which to measure the marker (eg a nested case-control design) may yield similar efficiency. Approaches to the design of both of these types of studies, including power calculations and recommendations regarding matching and stratification, will be developed. Methods for evaluating markers in designs that measure the marker on a subset of trial participants will also be provided. This research will be conducted in collaboration with international leaders in the fields of marker evaluation and clinical trial design and analysis. The methods will be applied to several important intervention trials where markers have been measured for treatment selection.

Public Health Relevance

Interventions for disease treatment and prevention can potentially be made more cost-effective by using markers to identify in advance the individuals most likely to benefit from the treatment, and thus avoid treating those unlikely to benefit. This proposal will develop methods to help realize this potential, by developing standards for evaluating candidate markers. These standards will help distinguish the good markers from the bad, optimize how the markers are used to select treatment, and ensure that research studies are designed so that the markers can be properly evaluated.

National Institute of Health (NIH)
National Cancer Institute (NCI)
Research Project (R01)
Project #
Application #
Study Section
Cancer Biomarkers Study Section (CBSS)
Program Officer
Jessup, John M
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Fred Hutchinson Cancer Research Center
United States
Zip Code
Huang, Ying; Laber, Eric B; Janes, Holly (2015) Characterizing expected benefits of biomarkers in treatment selection. Biostatistics 16:383-99
Kang, Chaeryon; Huang, Ying; Miller, Christopher J (2015) A discrete-time survival model with random effects for designing and analyzing repeated low-dose challenge experiments. Biostatistics 16:295-310
Pepe, Margaret S; Janes, Holly; Li, Christopher I (2014) Net risk reclassification p values: valid or misleading? J Natl Cancer Inst 106:dju041
Kang, Chaeryon; Janes, Holly; Huang, Ying (2014) Rejoinder: Combining biomarkers to optimize patient treatment recommendations. Biometrics 70:719-20
Kang, Chaeryon; Janes, Holly; Huang, Ying (2014) Combining biomarkers to optimize patient treatment recommendations. Biometrics 70:695-707
Kerr, Kathleen F; Wang, Zheyu; Janes, Holly et al. (2014) Net reclassification indices for evaluating risk prediction instruments: a critical review. Epidemiology 25:114-21
Janes, Holly; Brown, Marshall D; Huang, Ying et al. (2014) An approach to evaluating and comparing biomarkers for patient treatment selection. Int J Biostat 10:99-121
Janes, Holly; Pepe, Margaret S; Huang, Ying (2014) A framework for evaluating markers used to select patient treatment. Med Decis Making 34:159-67
Vickers, Andrew J; Pepe, Margaret (2014) Does the net reclassification improvement help us evaluate models and markers? Ann Intern Med 160:136-7
Zheng, Yingye; Cai, Tianxi; Pepe, Margaret S (2013) Adopting nested case-control quota sampling designs for the evaluation of risk markers. Lifetime Data Anal 19:568-88

Showing the most recent 10 out of 15 publications