Provide technical guidance on the use and interpretation of methods for assessing variation in treatment effects¶

Strategy · All strategies
Evidence · no claims cited

Description¶

Beyond summarizing the research literature, the report "provides technical guidance about the use and interpretation of these methods" for assessing how impacts differ across students, educators, and schools. This guidance is intended for analysts conducting education impact evaluations who must choose among subgroup analysis approaches and varying-effects estimation methods and interpret their results appropriately.

Design Implications¶

Context¶

Requirements¶

• An education impact evaluation (randomized controlled trial or quasi-experimental design) in which variation in impacts is to be assessed

Constraints¶

• The guidance is framed for education impact evaluations; the report's focus is randomized controlled trials

Target Learners¶

• students in educational interventions under evaluation

Target Learning Goals¶

• instructional practices and student learning outcomes assessed in impact evaluations

Related Strategies¶

Examples¶

-

Key Sources¶

• Peter Z. Schochet, Mike Puma, John Deke. (2014). Understanding Variation in Treatment Effects in Education Impact Evaluations: An Overview of Quantitative Methods. Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. https://ies.ed.gov/ncee