Interventions located in one or up to three geographical areas showed higher primary ITT and FSM effect sizes than interventions spread across more areas¶

Claim · All claims
Evidence · 1 study · quant-synthesis r3 · q3
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Primary ITT and FSM effect sizes were higher for interventions located in one or up to three geographical areas than for interventions in a greater number of areas; the pattern did not hold for secondary ITT effects. → Demack 2021

Evidence¶

Demack 2021¶

Demack, S., Maxwell, B., Coldwell, M., Stevens, A., Wolstenholme, C., Reaney-Wood, S., Stiell, B., & Lortie-Forgues, H. (2021). Review of EEF projects: Evaluation report. Education Endowment Foundation. https://eric.ed.gov/?id=ED625480

q3 · i? · quant-synthesis · r3

Subgroup meta-analysis of effect sizes by geographical context across the EEF trials. The review reports "higher effect sizes for interventions located in one or up to three geographical areas" and notes a similar pattern for FSM but not secondary ITT effects.

"The meta-analyses found an association between geographical context and primary ITT effect size that showed higher effect sizes for interventions located in one or up to three geographical areas compared to interventions located in a greater number of geographical areas."

Discussion¶

Related Claims¶

• Interventions with an English curriculum focus were associated with higher primary ITT effect sizes than maths or cross-curriculum focus, while maths focus was associated with higher secondary ITT effect sizes — related
• TA-led interventions were associated with higher primary ITT and FSM effect sizes than other interventions, a pattern not observed for secondary ITT effect sizes — related
• Across 82 EEF RCT evaluations, overall meta-analysis weighted mean effect sizes were small: +0.04 SD for primary ITT, +0.01 SD for secondary ITT, and +0.03 SD for FSM subsample attainment outcomes — related
• Effect sizes were higher for interventions with a total cost between £250k and £750k than for interventions that were more or less expensive — related
• Rural SIG schools reported additional challenges from remote locations and large catchment areas beyond those reported by nonrural SIG schools — related
• Smaller rural districts tend to outperform larger ones, but large geographic spread limits their capacity to manage turnaround efforts — related