Empirical example using data from a multi-armed education RCT¶

Element · All elements
Evidence · 1 claim (1 for) · 1 study (1 theoretical), q2 · 0 of 1 report an effect size · 1 claim rests on one study

Description¶

The article includes an empirical demonstration applying its design-based estimators to real data from a multi-armed education randomized controlled trial. As the abstract states, "An empirical example using data from a multi-armed education RCT demonstrates the issues." The example illustrates the variance adjustment and block-weighting issues the article identifies for multi-armed designs.

Design Implications¶

Context¶

Requirements¶

• Data from a multi-armed education RCT with multiple research groups

Constraints¶

Target Learners¶

• education researchers applying design-based estimators

Target Learning Goals¶

• demonstrating variance and weighting adjustments in practice

Claims¶

• Variance terms in multi-armed RCT estimators need slight adjustment under the finite-population framework, which can reduce precision [+W]

Related Elements¶

• Ten-RCT empirical comparison of CACE variance formulas

Examples¶

-

Key Sources¶

• Peter Z. Schochet. (2018). Design-Based Estimators for Average Treatment Effects for Multi-Armed RCTs. Journal of Educational and Behavioral Statistics, vol. 43, issue 5. https://www.mathematica.org/publications/design-based-estimators-for-average-treatment-effects-for-multi-armed-rcts