GAI-based teaching outperforms traditional teaching in practical skill development¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q3 · i2 medium
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i2 GAI-based teaching produced significantly higher skill scores than traditional teaching (SMD 0.63, 95% CI 0.10–1.16; p = 0.02), based on only two studies. → Li Juan 2025

Evidence¶

Li Juan 2025¶

Li Juan, Yin Kaiyu, Wang Yida, Jiang Xiaoqin, Chen Dongxu. (2025). Effectiveness of generative artificial intelligence-based teaching versus traditional teaching methods in medical education: a meta-analysis of randomized controlled trials. BMC Medical Education. https://doi.org/10.1186/s12909-025-07750-2

q3 · i2 · quant-synthesis · r2

Random-effects meta-analysis of skill scores from two RCTs (52 GAI-based and 51 traditional students). The pooled effect size was SMD = 0.63 (95% CI 0.10–1.16, p = 0.02, I² = 43%). The article flags the small study count as a limitation.

"the meta-analysis, which involved only two studies (52 GAI-based students and 51 traditional teaching students), showed that the GAI-based teaching had significantly higher skill scores compared to the traditional teaching method (SMD 0.63, 95% CI 0.10 to 1.16; p = 0.02; I² = 43%)"

Discussion¶

Related Claims¶

• GAI-based teaching improves knowledge scores when learning duration exceeds one week — related
• GAI-assisted teaching significantly improves practical examination scores in medical students compared with traditional teaching (SMD = 1.48) — a broader claim this one bears on
• GAI-based teaching yields higher knowledge scores in practice courses but not theory courses — related
• GAI-based teaching and traditional teaching produce comparable knowledge acquisition scores in medical students — related