Tutor CoPilot's benefit is largest for lower-rated and less-experienced tutors (9 p.p. and 7 p.p.), diminishing as tutor effectiveness increases¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r3 · q4
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q4 i? Lower-rated tutors' students gained 9 p.p. in exit-ticket passing (56%→65%) and lower-experienced tutors' students gained 7 p.p. (61%→68%). → Rose E. Wang 2025 q4 i? Treatment effects diminished with increasing tutor effectiveness, and treatment-group students of lower-rated or less-experienced tutors performed at or above the level of control-group students with higher-rated or more experienced tutors. → Rose E. Wang 2025 (2)

Evidence¶

Rose E. Wang 2025¶

Rose E. Wang, Ana T. Ribeiro, Carly D. Robinson, Susanna Loeb, and Dora Demszky. (2025). Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise. arXiv:2410.03017v2. https://arxiv.org/abs/2410.03017 doi:10.48550/arxiv.2410.03017

q4 · i? · causal · r3

Heterogeneity analysis of the RCT using exit-ticket passing rate, with tutor quality rating and tutoring experience categorized into tercile indicators interacted with treatment (Figure 2). The article prints percentage-point gains but no standardized effect size. Note the article's own typo labeling both results Figure 2a.

"In Figure 2a, lower-rated tutors experienced a 9 p.p. increase in student's passing their exit ticket (56%→ 65% student passing rate from control to treatment). In Figure 2a, lower-experienced tutors experienced a 7 p.p. increase (61%→ 68%)."

Rose E. Wang 2025 (2)¶

Rose E. Wang, Ana T. Ribeiro, Carly D. Robinson, Susanna Loeb, and Dora Demszky. (2025). Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise. arXiv:2410.03017v2. https://arxiv.org/abs/2410.03017

q4 · i? · causal · r3

Same heterogeneity analysis (Figure 2, by tutor quality rating and experience). The article interprets the pattern as Tutor CoPilot helping less-effective tutors achieve outcomes comparable to their more-effective peers. No standardized effect size is printed for this interaction pattern.

"We saw these treatment effects diminish with increasing tutor effectiveness, but notably, students of lower-rated or less-experienced tutors in the treatment group performed at or above the level of students with higher-rated or more experienced tutors in the control group."

Discussion¶

Related Claims¶

• Tutor Copilot Raises Exit Ticket Mastery 4Pp
• Tutors with Tutor CoPilot access use more understanding-fostering strategies (e.g., prompting students to explain) and rely less on giving away answers than control tutors — related
• Tutors perceive Tutor CoPilot as helpful for on-the-spot explanations but flag suggestions that are not grade-level appropriate and 'too smart' — related
• Tutor CoPilot shows no statistically significant effects on participation points, student survey outcomes, or end-of-year math test scores — related