Mind the Gap showed no statistically significant effect on the primary outcome of combined reading and numeracy attainment in Year 4 pupils¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r2 · q3 · i0 negligible
Currency · newest study 2014 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i0 The intervention had no statistically significant effect on the primary outcome, a combined reading and numeracy score, with an overall effect size of -0.141 (95% CI -0.697 to 0.414) across 492 pupils. → Dorsett 2014

Evidence¶

Dorsett 2014¶

Dorsett, R., Rienzo, C., Rolfe, H., Burns, H., Robertson, B.-A., Thorpe, B., & Wall, K. (2014). Mind the Gap: Evaluation Report and Executive Summary. Education Endowment Foundation. https://eric.ed.gov/?id=ED581160

q3 · i0 · causal · r2

Randomised controlled trial comparing Mind the Gap schools to business-as-usual control schools, with InCAS tests administered six months after intervention. The report states there was "no statistically significant effect on the primary outcome". The summary table prints an effect size of -0.141 (-0.697, 0.414) for 492 pupils, rated not statistically significant.

"The intervention had no statistically significant effect on the primary outcome, a combined reading and numeracy score , so we do not have sufficient evidence to conclude that any observed effect was caused by the programme rather than occurring by chance."

Dorsett 2014 (2)¶

Dorsett, R., Rienzo, C., Rolfe, H., Burns, H., Robertson, B.-A., Thorpe, B., & Wall, K. (2014). Mind the Gap: Evaluation Report and Executive Summary. Education Endowment Foundation. https://eric.ed.gov/?id=ED581160

q3 · i0 · causal · r2

Impact summary table row for the overall effect on all pupils: effect size -0.141 with confidence interval -0.697 to 0.414, estimated -2 months' progress, flagged "No" for statistical significance. The confidence interval passes through zero.

"Mind the Gap overall effect (all pupils) 492 -0.141 (-0.697, 0.414) -2 No"

Discussion¶

Related Claims¶

• Mind the Gap showed no statistically significant effect on attainment for FSM pupils — a narrower finding that bears on this claim
• An additional analysis using Key Stage 2 administrative test scores also found indeterminate, close-to-zero effects for Year 6 pupils. — related
• Mind the Gap showed no statistically significant effect on secondary outcomes including reading, general maths, mental arithmetic and pupils' feelings about their relationship with their parents — related
• The teacher training component alone showed no statistically significant effect on attainment — related
• Challenge the Gap showed no evidence of increased average attainment for primary or secondary pupils overall — related