Greater Medly engagement was positively associated with post-test attainment, treated as exploratory rather than causal¶
Claim · All claims
Evidence · 1 study · causalr2·q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Within the intervention group, each additional Medly question answered was associated with approximately 0.18 additional post-test marks after adjustment for baseline attainment. → Wayne Harrison 2026
Evidence¶
Wayne Harrison 2026¶
Wayne Harrison, Rahil Khowaja, Emma Dobson, Germaine Uwimpuhwe, and Steve Higgins. (2026). Evaluating AI Tutoring at the Speed of Innovation: Practitioner-Led Micro-Randomised Trials of an AI Tutoring Platform in GCSE Science. https://arxiv.org/abs/2609.14789 doi:10.48550/arxiv.2609.14789
q3 · i? · causal · r2
Exploratory post-randomisation analysis of platform-log engagement among intervention students only, adjusted for pre-test attainment. The association was positive overall and in each subject, but the authors state these analyses "cannot establish that increasing the number of questions answered would itself cause the observed increase in attainment".
"Each additional question answered was associated with approximately 0.18 additional post-test marks (95% CI 0.13 to 0.22). Positive associa-tions were also observed separately in Physics, Biology and Chemistry."
Discussion¶
Related Claims¶
- Allocation to Medly improved post-test GCSE science attainment relative to business-as-usual self-directed revision (Hedges' g = 0.33) — related
- Progressively larger treatment estimates among intervention students crossing engagement thresholds are hypothesis-generating only — related
- Positive subject-specific effects of Medly in Physics, Chemistry and Biology, with no evidence the effect differed across subjects — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
medly-engagement-attainment-associational |
title |
Greater Medly engagement was positively associated with post-test attainment, treated as exploratory rather than causal |
description |
Greater Medly engagement was positively associated with post-test attainment, treated as exploratory rather than causal |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — wayne-harrison-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.