Students learn more with a research-based AI tutor than with in-class active learning on identical content (post-test scores)¶
Claim · All claims
Evidence · 1 study · causalr2·q3
Currency · newest study 2025 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? In a crossover RCT, the AI-tutored group scored higher on post-tests than the in-class active learning group, a statistically significant difference. → Kestin 2025
Evidence¶
Kestin 2025¶
Kestin, G., Miller, K., Klales, A., Milbourne, T. & Ponti, G. (2025). AI tutoring outperforms in-class active learning: an RCT introducing a novel research-based design in an authentic educational setting. Scientific Reports 15:17458. https://doi.org/10.1038/s41598-025-97652-6
q3 · i? · causal · r2
Crossover RCT in an undergraduate physics course: students took a pre-test, experienced one lesson via AI tutor and one via in-class active learning, then post-tests. The AI group's "higher median (M) post-score" was 4.5 versus 3.5 in-class.
"Students in the AI group exhibited a higher median (M) post-score (M = 4.5, N = 142) compared to those in the in-class active learning group (M = 3.5, N = 174)."
Discussion¶
Related Claims¶
- Active Learning Improves Exam Performance — the general claim this finding bears on, with the studies behind it
- The AI-tutoring advantage holds across prior-ability and scientific-attitude subpopulations — related
- AI-tutored students spend less time on task than the 60-minute in-class lesson, with no correlation between time and scores — related
- Instruction type predicts post-test performance with a large effect size after controls (linear and quantile regression) — possibly the same claim (merge candidate)
- Students report higher engagement and motivation with the AI tutor, with comparable enjoyment and growth mindset — related
- Access to a structured conversational AI tutor increased post-test content scores over a no-AI holdout with ambient consumer AI available — related
- Unguarded answer-giving AI harmed unaided exam performance while a guarded version of the same model erased the harm (Bastani et al., 2025, as reported) — related
- A carefully engineered AI tutor produced more than twice the learning of a strong active-learning class, in less time (Kestin et al., 2025, as reported) — related
- AI access raises immediate unaided test scores by 7.2 percentage points (0.28 SD) after a timed learning phase — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
ai-tutor-beats-active-learning-post-test |
title |
Students learn more with a research-based AI tutor than with in-class active learning on identical content (post-test scores) |
description |
Students learn more with a research-based AI tutor than with in-class active learning on identical content (post-test scores) |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2025 |
source_checked |
2026-10-20 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — kestin-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.