The last two decades have been a period of experimentation in education policy in the United States, aimed at achieving the twin goals of boosting achievement and closing achievement gaps between disadvantaged and other students. Nearly all evaluations have focused on estimating the average impacts of these policies on student outcomes;some have also examined how these average impacts vary across subgroups of students defined by such characteristics as ethnicity and family socioeconomic status. As argued at length in Projects l-ll, developmental theory suggests that good and bad matches between student circumstances and intervention program design will produce heterogeneous program impacts, and that understanding the nature of this heterogeneity is essential for optimizing program design. Projects l-ll propose tests of child/policy fit hypotheses with interaction models allowing for differential program impacts across population subgroups that are defined by baseline characteristics. The current project develops and implements complementary approaches to testing child/policy fit hypotheses: quantile treatment effect estimation and other distributional estimators. It applies these techniques to data from four different education settings that range from pre-kindergarten to high school. In the case ofthe Head Start Impact Study and a voucher program to enable poor children to attend private schools in New York City, we test hypotheses suggesting ways in which modest overall effects mask systematic impact differences for children with different academic skills and behavioral characteristics. A third analysis will test hypotheses regarding the effects of policies encouraging middle schoolers to enroll in Algebra on the distribution of student motivation and achievement. Our final tests are of the distribution of impacts on effort and achievement of high-stakes exit exams as well as low-stakes (to students) accountability tests. The fifth year of our project would involve outreach activities designed to promote the use of these techniques more broadly in education evaluations.

Public Health Relevance

We propose to apply and extend new methods to the analysis of effects of four educational interventions across the full distribution of children's outcomes. Our research will make these techniques more accessible for applied researchers while testing theoretical predictions from achievement goal and developmental theory. Our research has implications for the use of overall and subgroup specific mean-based impacts as ways of targeting interventions.

National Institute of Health (NIH)
Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD)
Research Program Projects (P01)
Project #
Application #
Study Section
Special Emphasis Panel (ZHD1-DSR-W)
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of California Irvine
United States
Zip Code
Lee, Kenneth T H; Lewis, Ryan W; Kataoka, Sabrina et al. (2018) Out-of-School Time and Behaviors During Adolescence. J Res Adolesc 28:284-293
Penner, Emily K (2018) Early Parenting and the Reduction of Educational Inequality in Childhood and Adolescence. J Educ Res 111:213-231
Watts, Tyler W; Duncan, Greg J; Quan, Haonan (2018) Revisiting the Marshmallow Test: A Conceptual Replication Investigating Links Between Early Delay of Gratification and Later Outcomes. Psychol Sci 29:1159-1177
Bailey, Drew H; Duncan, Greg J; Watts, Tyler et al. (2018) Risky business: Correlation and causation in longitudinal studies of skill development. Am Psychol 73:81-94
Watts, Tyler W; Duncan, Greg J; Clements, Douglas H et al. (2018) What Is the Long-Run Impact of Learning Mathematics During Preschool? Child Dev 89:539-555
Jenkins, Jade M; Watts, Tyler W; Magnuson, Katherine et al. (2018) Do High-Quality Kindergarten and First-Grade Classrooms Mitigate Preschool Fadeout? J Res Educ Eff 11:339-374
Jenkins, Jade M; Duncan, Greg J; Auger, Anamarie et al. (2018) Boosting School Readiness: Should Preschool Teachers Target Skills or the Whole Child? Econ Educ Rev 65:107-125
Bailey, Drew H; Littlefield, Andrew K (2017) Does Reading Cause Later Intelligence? Accounting for Stability in Models of Change. Child Dev 88:1913-1921
Bailey, Drew; Duncan, Greg J; Odgers, Candice L et al. (2017) Persistence and Fadeout in the Impacts of Child and Adolescent Interventions. J Res Educ Eff 10:7-39
Hanselman, Paul; Rozek, Christopher S; Grigg, Jeffrey et al. (2017) New Evidence on Self-Affirmation Effects and Theorized Sources of Heterogeneity from Large-Scale Replications. J Educ Psychol 109:405-424

Showing the most recent 10 out of 46 publications