In Quantitative AI sessions, faster AI replies were associated with more engagement, more correct practice, and larger learning gains; these associations were not significant in Verbal¶
Claim · All claims
Evidence · 1 study · causalr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Across 12 AI tutors, lower latency was strongly associated with higher student engagement (Spearman ρ=−0.81, p=.006), and the reply-time→engagement→practice→gain chain held in Quantitative (all p≤.002) but not in Verbal. → Curtis Northcutt 2026
Evidence¶
Curtis Northcutt 2026¶
Curtis Northcutt, Inaara Hasmani, Kevin Feng, Trevor Khangi, Andreas Plesner, Jonas Mueller. (2026). StudentBench: AI and human tutoring yield equivalent GRE learning gains. https://arxiv.org/abs/2609.28470 doi:10.48550/arxiv.2609.28470
q2 · i? · causal · r2
Exploratory regressions on 1,137 Quantitative AI-tutoring sessions adjusting for starting score, AI tutor, and assessment form; the printed cross-tutor correlation was "Spearmanρ=−0.81, p=.006". Section-specific: associations not significant in Verbal (n=998).
"Faster replies were associated with more student engagement, more engagement with more correct practice, and more correct practice with greater learning gains (Figure 6; allp≤.002). These associations were not statistically significant in Verbal."
Discussion¶
Related Claims¶
- The best AI tutors exceeded human mean learning gains in Quantitative domains while human tutoring led pooled AI means in all Verbal domains — related
- Larger dense generators passed smoke probes but all exceeded the +30% classroom latency limit in bake-off round 1 — related
- Pooled AI tutoring produces statistically equivalent GRE learning gains to expert human tutoring — related
- Six AI tutors individually matched human tutoring, with Gemma 4 31B equivalent at 918× lower cost per percentage point of learning gain — related
- Sentiment is strongly negatively correlated with community engagement across GenAI education themes (ρ=−0.72) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
faster-ai-replies-linked-engagement-practice-gains |
title |
In Quantitative AI sessions, faster AI replies were associated with more engagement, more correct practice, and larger learning gains; these associations were not significant in Verbal |
description |
In Quantitative AI sessions, faster AI replies were associated with more engagement, more correct practice, and larger learning gains; these associations were not significant in Verbal |
status |
review |
evidence_strength |
mixed |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — curtis-northcutt-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.