Mathematics effects on FSM pupils differed by outcome status: near-zero as primary outcome (0.01) and negative as secondary outcome (-0.07)¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q3 · i0 negligible
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i0 Pooled maths effect sizes for FSM pupils were 0.01 (-0.02, 0.05) as a primary outcome and -0.07 (-0.15, 0.00) as a secondary outcome. → Bilal Ashraf 2021

Evidence¶

Bilal Ashraf 2021¶

Bilal Ashraf, Akansha Singh, Germaine Uwimpuhwe, Tahani Coolen-Maturi, Jochen Einbeck, Steve Higgins and Adetayo Kasim. (2021). Individual participant data meta-analysis of the impact of EEF trials on the educational attainment of pupils on Free School Meals: 2011 - 2019. Education Endowment Foundation. https://eric.ed.gov/?id=ED625398

q3 · i0 · quant-synthesis · r2

Subgroup IPD meta-analysis by primary/secondary outcome status (Table 8; 42 primary, 6 secondary maths trials). The report notes maths as a secondary outcome "had on average negative effects on FSM pupils, though there were just six trials"; the secondary-outcome credible interval includes zero.

"The pooled effect sizes for maths as primary and secondary outcomes were 0.01 (-0.02, 0.05) and -0.07(-0.15, 0.00), respectively."

Discussion¶

Related Claims¶

• EEF-funded interventions improved FSM pupils' literacy outcomes with a pooled effect size of 0.06, equivalent to about one month's progress — related
• EEF-funded interventions showed no evidence of positive or negative overall effects on FSM pupils' mathematics outcomes — related
• Across 82 EEF RCT evaluations, overall meta-analysis weighted mean effect sizes were small: +0.04 SD for primary ITT, +0.01 SD for secondary ITT, and +0.03 SD for FSM subsample attainment outcomes — related