Accurate evaluation of programs that treat and monitor HIV/AIDS patients around the world is central for fighting the epidemic. A major obstacle for program evaluation is patient dropout. An important such program is the President's Emergency Plan for AIDS Relief (PEPFAR). The US has been sponsoring PEPFAR ($63 billion for 2004-2013), and methods to accurately estimate patient survival are central to guide US management of the program. However, PEPFAR experiences high dropout rates (e.g., 39% in two years). Standard survival methods use only the observed non-dropout data, with no objective information for the dropouts. Such methods can be severely biased when dropout patients differ from nondropouts after accounting for observed information. To provide valid evaluation, in earlier work we have used a richer design known as "double-sampling". This design re-allocates increased resources to target, intensively pursue and find a subset of the dropouts. These double-sampled dropouts are intended to represent the non-double-sampled dropouts, and to provide objective information for the entire cohort. Although standard methods have been known for double-sampling in surveys, we have shown earlier that standard survival methods fail when double-sampling is used in continuous enrollment programs such as PEPFAR. Also, we have shown earlier that standard evaluation without double-sampling can dramatically underestimate mortality in PEPFAR by a factor of 5. The proposed methods will build on our earlier work with the framework of "principal stratification". The success of that framework increases the potential impact of this proposal. The proposed new methods are developed for three specific aims, motivated by PEPFAR in East Africa.
(Aim 1). Develop methods to estimate the performance of follow-up programs by using data from a given double- sampling design. In this aim we will develop methods to estimate survival from double-sampling designs that select patients based on their history characteristics before dropout. This is also important for the next two aims.
(Aim 2). Develop methods to create double-sampling designs that produce most accurate estimation of a pro- gram's performance given fixed resources. Evidence shows that information specific to a patient is important for what double-sampling designs provide best information about a program. Here, we will create patient-dependent double-sampling designs that maximize the accuracy given resources to estimate survival in such programs.
(Aim 3). Develop double-sampling designs to best target clinical goals.
Aim 1 can use the dropout patients'clinical history to predict those with highest mortality risk. These predictions can constrain the design to ensure to double-sample all such patients to better serve them medically.
In Aim 3, we will create designs that maximize the accuracy of estimation and best benefit patients.

Public Health Relevance

Accurate evaluation of programs monitoring HIV/AIDS patients, such as US-sponsored PEPFAR, is critical for fighting the epidemic, but is threatened by high rates of patient dropout. Evidence shows that dramatically inaccurate evaluations of existing methods can be corrected if the design concentrates resources to ascertain post-dropout information for a subset of the dropouts (double-sampling), but the use of double-sampling is limited because accurate and integrated methods for such designs of follow-up programs are lacking. This project proposes to develop integrated double-sampling designs and methods to accurately evaluate such monitoring programs and best benefit patients given limited resources.

National Institute of Health (NIH)
National Institute of Allergy and Infectious Diseases (NIAID)
Research Project (R01)
Project #
Application #
Study Section
AIDS Clinical Studies and Epidemiology Study Section (ACE)
Program Officer
Gezmu, Misrak
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
Johns Hopkins University
Biostatistics & Other Math Sci
Schools of Public Health
United States
Zip Code
Petersen, Maya; Yiannoutsos, Constantin T; Justice, Amy et al. (2014) Observational research on NCDs in HIV-positive populations: conceptual and methodological considerations. J Acquir Immune Defic Syndr 67 Suppl 1:S8-16
An, Ming-Wen; Frangakis, Constantine E; Yiannoutsos, Constantin T (2014) Choosing profile double-sampling designs for survival estimation with application to President's Emergency Plan for AIDS Relief evaluation. Stat Med 33:2017-29
Porsteinsson, Anton P; Drye, Lea T; Pollock, Bruce G et al. (2014) Effect of citalopram on agitation in Alzheimer disease: the CitAD randomized clinical trial. JAMA 311:682-91
Wu, Zhenke; Frangakis, Constantine E; Louis, Thomas A et al. (2014) Estimation of treatment effects in matched-pair cluster randomized trials by calibrating covariate imbalance between clusters. Biometrics 70:1014-22
Narayan, Anand; Hong, Kelvin; Streiff, Michael et al. (2014) The Impact of Cancer on the Clinical Outcome of Patients After Inferior Vena Cava Filter Placement: A Retrospective Cohort Study. Am J Clin Oncol :
Kiragga, Agnes N; Lok, Judith J; Musick, Beverly S et al. (2014) CD4 trajectory adjusting for dropout among HIV-positive patients receiving combination antiretroviral therapy in an East African HIV care centre. J Int AIDS Soc 17:18957
Petersen, Maya L; Tran, Linh; Geng, Elvin H et al. (2014) Delayed switch of antiretroviral therapy after virologic failure associated with elevated mortality among HIV-infected adults in Africa. AIDS 28:2097-107
Liublinska, Victoria; Rubin, Donald B (2014) Sensitivity analysis for a partially missing binary outcome in a two-arm randomized clinical trial. Stat Med 33:4170-85
Shinohara, Russell T; Narayan, Anand K; Hong, Kelvin et al. (2013) Estimating parsimonious models of longitudinal causal effects using regressions on propensity scores. Stat Med 32:3829-37
Go, Vivian F; Frangakis, Constantine; Le Minh, Nguyen et al. (2013) Effects of an HIV peer prevention intervention on sexual and injecting risk behaviors among injecting drug users and their risk partners in Thai Nguyen, Vietnam: a randomized controlled trial. Soc Sci Med 96:154-64