At pre-test there was no statistically significant difference in non-verbal reasoning between School 21 and control school students¶

Claim · All claims
Evidence · 1 study · design r2 · q2 · i1 small
Currency · newest study 2015 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2018: local conditions change quickly

Subclaims¶

q2 i1 Baseline raw-score differences between schools were not statistically significant (t(36) = 1.05, p = .302, d = 0.35), nor were age-standardised score differences (t(36) = 0.81, p = .423, d = 0.27). → Maxwell 2015

Evidence¶

Maxwell 2015¶

Maxwell, B., Burnett, C., Reidy, J., Willis, B., & Demack, S. (2015). Oracy Curriculum, Culture and Assessment Toolkit: Evaluation report and Executive summary. Education Endowment Foundation. https://eric.ed.gov/?id=ED581146

q2 · i1 · design · r2

Baseline comparison of Raven's Progressive Matrices scores between School 21 and control students in September 2013. The report prints d = 0.35 for raw scores and d = 0.27 for age-standardised scores, both non-significant, concluding there was no difference in initial non-verbal reasoning ability.

"the difference between the schools was not statistically significant for either the raw scores (t(36) = 1.05, p = .302, d = 0.35) or the age standardised scores (t(36) = 0.81, p = .423, d = 0.27)."

Discussion¶

Related Claims¶

• The oracy intervention showed no impact on Year 7 students' non-verbal reasoning skills as measured by the Raven's Progressive Matrices test — related
• Using raw rather than age-standardised scores reverses the FSM picture, yielding +0.36 for FSM-eligible pupils — related