Risk prediction equations are widely used in cardiovascular medicine for risk stratification and to determine cost-effective and appropriate courses of treatment. Whether new predictors can add clinical utility to established models such as the Framingham risk score is an important question. Previous work by these investigators has introduced new methods for comparing risk prediction models, including risk reclassification, which assesses the ability of new models to more accurately classify individuals into higher or lower risk strata. This proposal offers several novel extensions of these methods, particularly related to calibration, which directly compares the predicted to the observed risk. Such calibration is essential for estimating risk for the individual and computing differences in absolute risk. While measures of improvement in discrimination are available, this application proposes an integrated approach examining improvement in calibration. Also, since pre-specified risk strata are not identified for all applications, a category-free measure of reclassification calibration is proposed. A second area of interest is extending methods for reclassification calibration to other study designs. While methods for survival data are available for discrimination measures, how well measures of calibration, particularly the reclassification chi-square statistic, extend to survival settings is not yet known. In addition, case-cohort and matched case-control studies are widely used in cardiovascular research, especially for biomarker assessment. It is not known how well reclassification measures translate to these designs. Finally, to limit costs, clinicians are often interested in multi-stage screening of diseae. Reclassification of those at intermediate risk is of most interest, and the 'clinical NRI'has been introduced to assess reclassification in this group. How well this new method performs in practice remains to be determined. We propose to conduct a portfolio of research projects regarding the comparison of predictive models in general, and reclassification calibration specifically, that will further the development of these methods and their clinical utility. We wil examine the characteristics of the new measures in data on cardiovascular disease from the Women's Health Study, in simulations, and in existing case-control and case-cohort data on CVD outcomes. Extensions to these novel applications would be highly innovative and directly and immediately applicable to clinical risk prediction for cardiovascular disease.

Public Health Relevance

Risk prediction equations are widely used in cardiovascular medicine for risk stratification and to determine cost-effective and appropriate courses of treatment. This project proposes to develop new methods for comparison of risk prediction models, particularly related to reclassification calibration. It will extend these methods to other study designs and settings other than binary outcomes.

National Institute of Health (NIH)
National Heart, Lung, and Blood Institute (NHLBI)
Research Project (R01)
Project #
Application #
Study Section
Cardiovascular and Sleep Epidemiology (CASE)
Program Officer
Burwen, Dale R
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Brigham and Women's Hospital
United States
Zip Code
Cook, Nancy R; Mora, Samia; Ridker, Paul M (2018) Lipoprotein(a) and Cardiovascular Risk Prediction Among Women. J Am Coll Cardiol 72:287-296
Demler, Olga V; Pencina, Michael J; Cook, Nancy R et al. (2017) Asymptotic distribution of ?AUC, NRIs, and IDI based on theory of U-statistics. Stat Med 36:3334-3360
Cook, Nancy R; Demler, Olga V; Paynter, Nina P (2017) Clinical risk reclassification at 10 years. Stat Med 36:4498-4502
Paynter, Nina P; Cook, Nancy R (2016) Adding tests to risk based guidelines: evaluating improvements in prediction for an intermediate risk group. BMJ 354:i4450
Srivastava, Pratyaksh K; Pradhan, Aruna D; Cook, Nancy R et al. (2016) Impact of Modifiable Risk Factors on B-type Natriuretic Peptide and Cardiac Troponin T Concentrations. Am J Cardiol 117:376-81
Everett, Brendan M; Ridker, Paul M; Cook, Nancy R et al. (2015) Usefulness of B-type Natriuretic Peptides to Predict Cardiovascular Events in Women (from the Women's Health Study). Am J Cardiol 116:532-7
Demler, Olga V; Paynter, Nina P; Cook, Nancy R (2015) Tests of calibration and goodness-of-fit in the survival setting. Stat Med 34:1659-80
Paynter, Nina P; Everett, Brendan M; Cook, Nancy R (2014) Cardiovascular disease risk prediction in women: is there a role for novel biomarkers? Clin Chem 60:88-97
Paynter, Nina P; LaMonte, Michael J; Manson, JoAnn E et al. (2014) Comparison of lifestyle-based and traditional cardiovascular disease prediction in a multiethnic cohort of nonsmoking women. Circulation 130:1466-73
Paynter, Nina P; Cook, Nancy R (2012) Re.: ""Association of small artery elasticity with incident cardiovascular disease in older adults: the Multi-ethnic Study of Atherosclerosis"". Am J Epidemiol 175:156; author reply 156-8

Showing the most recent 10 out of 11 publications