ITS groups outperformed conventional-instruction controls in 92% of the 50 evaluations, with gains above 0.25 SD in 78%¶
Claim · All claims
Evidence · 1 study · quant-synthesisr?·q4
Currency · newest study 2016 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q4 i? Students receiving intelligent tutoring outperformed control students in 46 (92%) of 50 studies, and gains exceeded 0.25 standard deviations in 39 (78%) of studies. → Kulik 2016
Evidence¶
Kulik 2016¶
Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review. Review of Educational Research. https://doi.org/10.3102/0034654315581420
q4 · i? · quant-synthesis · r?
Primary meta-analysis of the 50 qualifying controlled evaluations. The article reports that gains were "larger than 0.25 standard deviations" — the What Works Clearinghouse threshold for substantive importance — in 39 of the 50 studies. No effect size is attached to this proportion finding.
"Students who received intelligent tutoring outperformed control students on posttests in 46 (or 92%) of the 50 studies. In 39 (or 78%) of the 50 studies, tutoring gains were larger than 0.25 standard deviations"
Discussion¶
Related Claims¶
- Intelligent tutoring raised test scores by a median of 0.66 standard deviations over conventional instruction across 50 controlled evaluations — a broader claim this one bears on
- Intelligent tutoring systems improve achievement over non-individualised instruction — related
- The DARPA Digital Tutor, an ITS for U.S. Navy information systems technicians, produced the largest effects in the data set (average ES of 1.97 and 3.18 in two summative evaluations) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
its-beat-controls-in-92-percent-of-evaluations |
title |
ITS groups outperformed conventional-instruction controls in 92% of the 50 evaluations, with gains above 0.25 SD in 78% |
description |
ITS groups outperformed conventional-instruction controls in 92% of the 50 evaluations, with gains above 0.25 SD in 78% |
status |
review |
evidence_strength |
strong |
newest_evidence |
2016 |
generated |
by process:wiki-ingest on 2026-10-13 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — kulik-2016 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.