A quarter of students offered a free AI tutor never tried it once, making first-session adoption a deployment problem¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? 14 of 52 AI-arm students who consented never held a single tutoring session, which the authors call a substantive finding about adoption rather than a nuisance. → Shihao Yang 2026

Evidence¶

Shihao Yang 2026¶

Shihao Yang, Marshall Van Alstyne, and Chrysanthos Dellarocas. (2026). When AI Tutors Speak: Evidence from a Randomized Field Experiment. https://arxiv.org/abs/2609.23958 doi:10.48550/arxiv.2609.23958

q3 · i? · causal · r2

Participation analysis in the five-week field period: weekly completion of the 20-minute engaged-time goal was 29/31/28/30/26 of 52 in the AI arm; 27 AI students completed at least four of five weeks.

"Attrition was concentrated at the start: 14 AI students who consented never held a single session, and 7 holdout students never completed a check-in. This early non-use is a substantive finding about adoption rather than a mere nuisance: a quarter of the students offered a free tutor never tried it once."

Discussion¶

Related Claims¶

• Access to a structured conversational AI tutor increased post-test content scores over a no-AI holdout with ambient consumer AI available — related
• The instructor's own final exam showed the same direction of advantage on the intact randomized sample, with no difference on the pre-treatment midterm — related
• Reviews citing one randomised trial (Bastani et al. 2025) report that unrestricted GPT-4 access in high-school mathematics raised assisted practice performance but left students worse off after withdrawal — related
• Ambient consumer AI use in the holdout did not close the structured-tutor gap — related