AI tutoring yields a small, statistically significant improvement in expert-rated OSATS scores versus expert instruction, with low certainty¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? AI tutoring produced a small statistically significant improvement in expert-rated OSATS scores compared with expert instruction (MD 0.20; 95% CI 0.01 to 0.39), with no heterogeneity but low certainty. → Hanna Fouad et al 2026

Evidence¶

Hanna Fouad et al 2026¶

Hanna Fouad et al. (2026). Artificial intelligence augmented tutoring vs expert instruction on learning simulated general surgical skills: a systematic review and meta-analysis. BMC Medical Education. https://doi.org/10.1186/s12909-026-09606-9

q2 · i? · quant-synthesis · r2

Meta-analysis of four studies (3 RCTs and 1 pilot prospective study, 268 total participants) comparing AI tutoring with expert instruction, reported in the article's Results. The pooled mean difference in "expert-rated OSATS scores (MD 0.20; 95% CI, 0.01 to 0.39)" was significant with I2 = 0%, rated low certainty via GRADE.

"AI tutoring showed a small, statistically significant improvement in expert-rated OSATS scores (MD 0.20; 95% CI, 0.01 to 0.39) with no heterogeneity (I2 = 0%) but with low certainty."

Discussion¶

Related Claims¶

• No significant difference in ICEMS performance scores between AI tutoring and expert instruction — related
• Pooled AI tutoring produces statistically equivalent GRE learning gains to expert human tutoring — related
• AI-enabled personalized STEM education yields a statistically significant overall effect of g = 0.455, which its authors class as small, compared with traditional non-AI instruction in K-12 schools — related
• AR-assisted training improves OSATS Global scores in novice laparoscopic learners — related