Pooled AI tutoring produces statistically equivalent GRE learning gains to expert human tutoring¶
Claim · All claims
Evidence · 1 study · causalr2·q2
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Across 2,383 participants, pooled AI tutoring and expert human tutoring yielded statistically equivalent learning gains on the combined GRE sections (p=.015 under ±0.25-SD equivalence bounds). → Curtis Northcutt 2026
Evidence¶
Curtis Northcutt 2026¶
Curtis Northcutt, Inaara Hasmani, Kevin Feng, Trevor Khangi, Andreas Plesner, Jonas Mueller. (2026). StudentBench: AI and human tutoring yield equivalent GRE learning gains. https://arxiv.org/abs/2609.28470 doi:10.48550/arxiv.2609.28470
q2 · i? · causal · r2
Randomized experiment comparing AI tutoring, human tutoring, and control across 2,469 sessions from 2,383 students with pre/post GRE assessments, ANCOVA-adjusted. Equivalence held with "combined AI− human difference was−0.58percentage points"; no standardized effect size printed.
"Human tutoring and AI tutoring pooled across all AI tutors produced equivalent mean learning gains across the combined Quantitative and Verbal sessions (p=.015,±0.25-SD bounds; also significant under the tighter ±0.20-SD bounds,p=.023; 1.59 d.f.). The combined AI− human difference was−0.58percentage points (90% CI[−2.18,1.03])."
Discussion¶
Related Claims¶
- Both AI and human tutoring produce larger GRE learning gains than a no-tutoring control — related
- The best AI tutors exceeded human mean learning gains in Quantitative domains while human tutoring led pooled AI means in all Verbal domains — related
- In Quantitative AI sessions, faster AI replies were associated with more engagement, more correct practice, and larger learning gains; these associations were not significant in Verbal — related
- Six AI tutors individually matched human tutoring, with Gemma 4 31B equivalent at 918× lower cost per percentage point of learning gain — related
- Scenario-based tutor lessons produced a significant pooled 7.4% learning gain, driven by three lessons with established construct validity while three newer lessons showed no significant gains — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
pooled-ai-tutoring-equivalent-gre-learning-gains |
title |
Pooled AI tutoring produces statistically equivalent GRE learning gains to expert human tutoring |
description |
Pooled AI tutoring produces statistically equivalent GRE learning gains to expert human tutoring |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
source_checked |
2026-10-20 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — curtis-northcutt-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.