No significant difference in ICEMS performance scores between AI tutoring and expert instruction¶
Claim · All claims
Evidence · 1 study · quant-synthesisr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The meta-analysis found no statistically significant difference in ICEMS Expertise Scores between AI tutoring and expert instruction. → Hanna Fouad et al 2026
Evidence¶
Hanna Fouad et al 2026¶
Hanna Fouad et al. (2026). Artificial intelligence augmented tutoring vs expert instruction on learning simulated general surgical skills: a systematic review and meta-analysis. BMC Medical Education. https://doi.org/10.1186/s12909-026-09606-9
q2 · i? · quant-synthesis · r2
Meta-analysis of the four included comparative studies reported in the article's Results, using the ICEMS Expertise Score (expert predictions from −1.00 novice to 1.00 expert computed every 0.2 s) as the primary performance outcome; "No significant difference was found in ICEMS scores."
"No significant difference was found in ICEMS scores."
Discussion¶
Related Claims¶
- AI tutoring yields a small, statistically significant improvement in expert-rated OSATS scores versus expert instruction, with low certainty — related
- Ma et al. (2014) meta-analysis: step-based ITSs outperformed no tutoring and large-group teacher-led instruction, but showed no differences against small-group or one-to-one human tutoring — a broader claim this one bears on
- Intelligent tutoring systems improve achievement over non-individualised instruction — a broader claim this one bears on
- ITS substitution: meta-analyses find no significant cognitive learning differences between ITS and human tutoring or small-group instruction — a broader claim this one bears on
- VanLehn (2011) found step-based intelligent tutoring systems nearly as effective as average human tutors, and both more effective than no tutoring but less effective than expert human tutors — a broader claim this one bears on
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.