Tutor CoPilot shows no statistically significant effects on participation points, student survey outcomes, or end-of-year math test scores¶

Claim · All claims
Evidence · 1 study · causal r3 · q4
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q4 i? The study did not find statistically significant improvements in end-of-year math test scores, which the authors attribute to little variation in treatment exposure and the two-month duration. → Rose E. Wang 2025

Evidence¶

Rose E. Wang 2025¶

Rose E. Wang, Ana T. Ribeiro, Carly D. Robinson, Susanna Loeb, and Dora Demszky. (2025). Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise. arXiv:2410.03017v2. https://arxiv.org/abs/2410.03017 doi:10.48550/arxiv.2410.03017

q4 · i? · causal · r3

Null result on end-of-year NWEA MAP math scores, stated in the Limitations section and analyzed in Appendix K. The authors attribute it to little variation in treatment exposure and the study's two-month duration. No effect size is printed in the available text.

"Additionally, while we observed substantial improvements in students' proximal learning gains (i.e., the students' exit ticket performance), we did not find statistically significant improvements in end-of-year math test scores; please refer to Appendix K for this analysis."

Discussion¶

Related Claims¶

• Tutor Copilot Raises Exit Ticket Mastery 4Pp
• Tutors perceive Tutor CoPilot as helpful for on-the-spot explanations but flag suggestions that are not grade-level appropriate and 'too smart' — related
• Tutor CoPilot's benefit is largest for lower-rated and less-experienced tutors (9 p.p. and 7 p.p.), diminishing as tutor effectiveness increases — related
• Math confidence increased slightly among students completing both baseline and end-of-year surveys, but the difference was not statistically significant — a narrower finding that bears on this claim