Better information about the benefits of interventions in individuals has enormous potential to improve clinical decision making. Yet cost effectiveness analyses (CEA) are almost always based on average incremental cost and average incremental benefits found in groups. Since health care resources are allocated by decisions made by and for individual patients, use of average cost effectiveness (CE) ratios can be inappropriate and misleading. Interventions that are cost effective on average may not be cost effective for many (even for most) patients with the index condition and-conversely-interventions that are nominally cost-ineffective may be highly worthwhile in some. Concerns about the inappropriateness of applying average population CE ratios parallel concerns about what treatment is best for an individual patient based on summary results of clinical trials. Our prior work using risk models has shown that substantial differences in baseline risk are ubiquitous across individuals with the same index condition. This risk heterogeneity gives rise to substantial, and often clinically meaningful, differences in therapeutic benefits--particularly when benefits are considered on the absolute scale, the most relevant measure for clinical decision making and CEA. Clinical Prediction Models (CPMs) can be used across research and practice domains to address this risk heterogeneity and are abundant in the literature. Despite the important concerns about the use of average effects and average CE ratios and the availability of CPMs, the potential health and economic impact of better individualization of risk information on clinical decisions remains largely unexamined. Further, just as CEAs typically ignore the potential for population risk stratification, traditional measures used to evaluate CPM and novel risk biomarkers typically ignore the decisional context in which the predictions are applied, and focus instead on utility-free measures of statistical accuracy. Not surprisingly, these measures often poorly anticipate the ultimate clinical usefulness of the predictive information. Thus, our specific aims are:
Aim 1 To examine the expected value of a risk-based approach to individualizing care and cost effectiveness across a broad range of medical interventions;
Aim 2 : To develop and test appropriate methods to assess prediction models, and incremental improvements in risk prediction, based on a decision analytic framework that estimates the health and economic impact of improved individualized medical decision-making;
Aim 3 : To explore the policy implications of using a risk-based approach to individualize care by: (a) simulating the impact of incentive-based programs, and (b) engaging stakeholders on real-world implementation. This project will: 1) elucidate the overall value of targeting therapy using a risk-based approach; 2) help us understand the circumstances in which such an approach might be especially useful; 3) provide heuristics and tools to expedite the evaluation of CPMs and novel risk biomarkers; and 4) help us understand how best to incentivize their translation into clinical practice.

Public Health Relevance

The proposed research explores the value of providing to clinicians and patients information regarding each patient's individualized risk of having bad health outcomes so that clinicians can better tailor care. It also aims to develop new tools and methods to help recognize when a new risk factor (e.g., a new biomarker) may provide clinically useful information, and when it is unlikely to do so. Finally, we will explore the potential for improving health through doctor and patient incentives to make decisions those better match patient risks, values and preferences.

Agency
National Institute of Health (NIH)
Institute
National Institute of Neurological Disorders and Stroke (NINDS)
Type
Research Project--Cooperative Agreements (U01)
Project #
5U01NS086294-05
Application #
9336976
Study Section
Special Emphasis Panel (ZRG1)
Program Officer
Rosenberg, Ellen
Project Start
2013-09-30
Project End
2019-08-31
Budget Start
2017-09-01
Budget End
2019-08-31
Support Year
5
Fiscal Year
2017
Total Cost
Indirect Cost
Name
Tufts University
Department
Type
DUNS #
079532263
City
Boston
State
MA
Country
United States
Zip Code
02111
Shah, Nilay D; Steyerberg, Ewout W; Kent, David M (2018) Big Data and Predictive Analytics: Recalibrating Expectations. JAMA 320:27-28
Van Calster, Ben; Wynants, Laure; Verbeek, Jan F M et al. (2018) Reporting and Interpreting Decision Curve Analysis: A Guide for Investigators. Eur Urol 74:796-804
Kumar, Vaibhav; Cohen, Joshua T; van Klaveren, David et al. (2018) Risk-Targeted Lung Cancer Screening: A Cost-Effectiveness Analysis. Ann Intern Med 168:161-169
van Klaveren, David; Steyerberg, Ewout W; Serruys, Patrick W et al. (2018) The proposed 'concordance-statistic for benefit' provided a useful metric when modeling heterogeneous treatment effects. J Clin Epidemiol 94:59-68
Cohen, Joshua T; Neumann, Peter J; Wong, John B (2017) A Call for Open-Source Cost-Effectiveness Analysis. Ann Intern Med 167:432-433
van Klaveren, David; Wong, John B; Kent, David M et al. (2017) Biases in Individualized Cost-effectiveness Analysis: Influence of Choices in Modeling Short-Term, Trial-Based, Mortality Risk Reduction and Post-Trial Life Expectancy. Med Decis Making 37:770-778
Austin, Peter C; van Klaveren, David; Vergouwe, Yvonne et al. (2017) Validation of prediction models: examining temporal and geographic stability of baseline risk and estimated covariate effects. Diagn Progn Res 1:12
Costa, Francesco; van Klaveren, David; James, Stefan et al. (2017) Derivation and validation of the predicting bleeding complications in patients undergoing stent implantation and subsequent dual antiplatelet therapy (PRECISE-DAPT) score: a pooled analysis of individual-patient datasets from clinical trials. Lancet 389:1025-1034
Paulus, Jessica K; Kent, David M (2017) Race and Ethnicity: A Part of the Equation for Personalized Clinical Decision Making? Circ Cardiovasc Qual Outcomes 10:
Cohen, Joshua T; Wong, John B (2017) Can Economic Model Transparency Improve Provider Interpretation of Cost-Effectiveness Analysis? A Response. Med Care 55:912-914

Showing the most recent 10 out of 28 publications