Cross-site impact variation has implications for the statistical precision of multisite trials¶

Claim · All claims
Evidence · 1 study · causal r? · q2
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The article considers the implications of cross-site impact variation for the statistical precision of multisite trials. → Michael J. Weiss 2017

Evidence¶

Michael J. Weiss 2017¶

Michael J. Weiss, Howard S. Bloom, Natalya Verbitsky-Savitz, Himani Gupta, Alma E. Vigil, Daniel N. Cullinan. (2017). How Much Do the Effects of Education and Training Programs Vary Across Sites? Evidence from Past Multisite Randomized Trials. Journal of Research on Educational Effectiveness, vol. 10, issue 4. https://www.mathematica.org/publications/how-much-do-the-effects-of-education-and-training-programs-vary-across-sites-evidence doi:10.1080/19345747.2017.1300719

q2 · i? · causal · r?

The abstract states the authors "consider the implications of this variation for the statistical precision of multisite trials". The available text does not print the specific precision findings or recommendations.

"we consider the implications of this variation for the statistical precision of multisite trials"

Discussion¶

Related Claims¶

• Cross-site standard deviations of ITT effects were estimated for education and workforce interventions using data from 16 large multisite randomized controlled trials — related
• The study explores hypotheses about factors that predict the magnitude of cross-site impact variation — related
• Many education evaluations have sufficient power to detect precise impacts only for relatively large subgroups of sites — a narrower finding that bears on this claim