Better information about the benefits of interventions in individuals has enormous potential to improve clinical decision making. Yet cost effectiveness analyses (CEA) are almost always based on average incremental cost and average incremental benefits found in groups. Since health care resources are allocated by decisions made by and for individual patients, use of average cost effectiveness (CE) ratios can be inappropriate and misleading. Interventions that are cost effective on average may not be cost effective for many (even for most) patients with the index condition and-conversely-interventions that are nominally cost-ineffective may be highly worthwhile in some. Concerns about the inappropriateness of applying average population CE ratios parallel concerns about what treatment is best for an individual patient based on summary results of clinical trials. Our prior work using risk models has shown that substantial differences in baseline risk are ubiquitous across individuals with the same index condition. This risk heterogeneity gives rise to substantial, and often clinically meaningful, differences in therapeutic benefits--particularly when benefits are considered on the absolute scale, the most relevant measure for clinical decision making and CEA. Clinical Prediction Models (CPMs) can be used across research and practice domains to address this risk heterogeneity and are abundant in the literature. Despite the important concerns about the use of average effects and average CE ratios and the availability of CPMs, the potential health and economic impact of better individualization of risk information on clinical decisions remains largely unexamined. Further, just as CEAs typically ignore the potential for population risk stratification, traditional measures used to evaluate CPM and novel risk biomarkers typically ignore the decisional context in which the predictions are applied, and focus instead on """"""""utility-free"""""""" measures of statistical accuracy. Not surprisingly, these measures often poorly anticipate the ultimate clinical usefulness of the predictive information. Thus, our specific aims are:
Aim 1 : To examine the expected value of a risk-based approach to individualizing care and cost effectiveness across a broad range of medical interventions;
Aim 2 : To develop and test appropriate methods to assess prediction models, and incremental improvements in risk prediction, based on a decision analytic framework that estimates the health and economic impact of improved individualized medical decision-making;
Aim 3 : To explore the policy implications of using a risk-based approach to individualize care by: (a) simulating the impact of incentive-based programs, and (b) engaging stakeholders on real-world implementation. This project will: 1) elucidate the overall value of targeting therapy using a risk-based approach;2) help us understand the circumstances in which such an approach might be especially useful;3) provide heuristics and tools to expedite the evaluation of CPMs and novel risk biomarkers; and 4) help us understand how best to incentivize their translation into clinical practice.

Public Health Relevance

The proposed research explores the value of providing to clinicians and patients information regarding each patient's individualized risk of having bad health outcomes so that clinicians can better tailor care. It also aims to develop new tools and methods to help recognize when a new risk factor (e.g., a new biomarker) may provide clinically useful information, and when it is unlikely to do so. Finally, we will explore the potential for improving health through doctor and patient incentives to make decisions those better match patient risks, values and preferences.

National Institute of Health (NIH)
National Institute of Neurological Disorders and Stroke (NINDS)
Research Project--Cooperative Agreements (U01)
Project #
Application #
Study Section
Special Emphasis Panel (ZRG1-HDM-W (52))
Program Officer
Hirtz, Deborah G
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Tufts University
United States
Zip Code
Paulus, Jessica K; Wessler, Benjamin S; Lundquist, Christine et al. (2016) Field Synopsis of Sex in Clinical Prediction Models for Cardiovascular Disease. Circ Cardiovasc Qual Outcomes 9:S8-15
Kent, David M; Nelson, Jason; Dahabreh, Issa J et al. (2016) Risk and treatment effect heterogeneity: re-analysis of individual participant data from 32 large clinical trials. Int J Epidemiol :
Paulus, Jessica K; Lai, Lana Y H; Lundquist, Christine et al. (2016) Field Synopsis of the Role of Sex in Stroke Prediction Models. J Am Heart Assoc 5:
Thompson, Douglas D; Lingsma, Hester F; Whiteley, William N et al. (2015) Covariate adjustment had similar benefits in small and large randomized controlled trials. J Clin Epidemiol 68:1068-75
Vickers, Andrew J; Kent, David M (2015) The Lake Wobegon Effect: Why Most Patients Are at Below-Average Risk. Ann Intern Med 162:866-7
Paulus, Jessica K; Shah, Nilay D; Kent, David M (2015) All else being equal, men and women are still not the same: using risk models to understand gender disparities in care. Circ Cardiovasc Qual Outcomes 8:317-20
Wessler, Benjamin S; Lai Yh, Lana; Kramer, Whitney et al. (2015) Clinical Prediction Models for Cardiovascular Disease: Tufts Predictive Analytics and Comparative Effectiveness Clinical Prediction Model Database. Circ Cardiovasc Qual Outcomes 8:368-75
Tangri, Navdeep; Kent, David M (2015) Toward a modern era in clinical prediction: the TRIPOD statement for reporting prediction models. Am J Kidney Dis 65:530-3
Kozminski, Michael A; Wei, John T; Nelson, Jason et al. (2015) Baseline characteristics predict risk of progression and response to combined medical therapy for benign prostatic hyperplasia (BPH). BJU Int 115:308-16
Steyerberg, Ewout W; Vergouwe, Yvonne (2014) Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J 35:1925-31