Structured clinical performance shows the largest pooled signal (SMD 3.39) but rests on a very small evidence base¶
Claim · All claims
Evidence · 1 study · quant-synthesisr2·q3·i3large
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i3 Structured clinical performance showed the clearest pooled positive signal (2 studies; 38 vs. 39 participants; SMD 3.39, 95% CI 1.43 to 5.35), though the review cautions the estimate may be inflated. → Liu Xiaoliu 2026
Evidence¶
Liu Xiaoliu 2026¶
Liu Xiaoliu, Pan Jiayue, Zhang Chengyi, Wang Xiaomei, Wan Jinghua, Wang Qiang. (2026). Effectiveness of large language model-based teaching interventions in medical education: a systematic review and stratified meta-analysis of 14 studies. BMC Medical Education. https://doi.org/10.1186/s12909-026-09879-0
q3 · i3 · quant-synthesis · r2
Supplementary random-effects meta-analysis of structured or examination-based clinical performance outcomes from 2 studies (38 vs. 39 participants). The printed effect size is SMD 3.39 (95% CI 1.43 to 5.35). The review warns this is "a small-study signal from only 77 participants"; selective reporting and measurement artifact cannot be excluded; certainty was low.
"Structured clinical performance included 2 studies (38 vs. 39 participants), with a pooled effect of SMD 3.39 (95% CI 1.43 to 5.35) (Fig. 6)."
Discussion¶
Related Claims¶
- Gamified clinical skill learning produces the largest effects on skill performance, with very high between-study heterogeneity — related
- Delayed retention shows no clear difference between LLM-based and traditional teaching (SMD 0.15) — related
- LLM-based teaching is associated with higher post-course score-based outcomes than non-AI teaching in an exploratory pooled synthesis (SMD 0.90), with very high heterogeneity — related
- Strict knowledge acquisition shows a smaller positive pooled signal for LLM-based teaching (SMD 0.80) — related
- Pooled risk difference across 11 student‐clinic studies is 0.43 but with considerable heterogeneity (I² = 93%) — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.