A carefully engineered AI tutor produced more than twice the learning of a strong active-learning class, in less time (Kestin et al., 2025, as reported)¶
Claim · All claims
Evidence · 1 study · theoreticalr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? In a randomized undergraduate physics study reported by Kestin et al. (2025), a carefully engineered AI tutor produced more than twice the learning of a strong active-learning class in less time. → Mario Brcic 2026
Evidence¶
Mario Brcic 2026¶
Mario Brcic, Stjepan Frljic. (2026). The Effortless Trap: Productive Struggle, AI, and the Illusion of Learning. Preprint. https://arxiv.org/abs/2606.26181 doi:10.48550/arxiv.2606.26181
q2 · i? · theoretical · r2
The article reports, citing Kestin et al. (2025), a randomized study in undergraduate physics comparing an engineered AI tutor against strong active-learning classes, with more than twice the learning in less time. No effect size is printed in the article.
"In a separate randomized study of undergraduate physics, a carefully engineered AI tutor produced more than twice the learning of a strong active-learning class (Freeman et al., 2014; Crouch and Mazur, 2001), in less time (Kestin et al., 2025)."
Discussion¶
Related Claims¶
- Effortful, fluent-feeling experiences can create an illusion of learning: felt sense of learning is a poor gauge of actual learning — related
- Offloading work to AI costs learning: students given answers did well in practice but scored lower on an unassisted exam — related
- Active Learning Improves Exam Performance — related
- In one RCT, a content-rich prompt-engineered generative AI chat tutor improved performance and engagement in a Harvard physics course — possibly the same claim (merge candidate)
- AI tutors explicitly designed according to educational theory outperformed traditional active learning in rigorous academic settings — possibly the same claim (merge candidate)
- Students learn more with a research-based AI tutor than with in-class active learning on identical content (post-test scores) — related
- AI-tutored students spend less time on task than the 60-minute in-class lesson, with no correlation between time and scores — a narrower finding that bears on this claim
- Students report higher engagement and motivation with the AI tutor, with comparable enjoyment and growth mindset — a narrower finding that bears on this claim
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
engineered-ai-tutor-doubled-learning-vs-active-learning |
title |
A carefully engineered AI tutor produced more than twice the learning of a strong active-learning class, in less time (Kestin et al., 2025, as reported) |
description |
A carefully engineered AI tutor produced more than twice the learning of a strong active-learning class, in less time (Kestin et al., 2025, as reported) |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — mario-brcic-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.