Prioritize larger multi-center RCTs with standardized AR systems, uniform metrics, and long-term follow-up when evaluating AR surgical training¶

Strategy · All strategies
Evidence · 6 claims (6 for) · 1 study (1 quant-synthesis), q3 · 0 of 1 report an effect size · 6 claims rest on one study

Description¶

The authors' forward-looking research and design recommendation for AR in surgical education. They argue current evidence is limited by heterogeneous designs and systems, so "Conducting larger, multi-center RCTs with standardized AR systems and training protocols will enhance the robustness and generalizability of findings", alongside uniform evaluation metrics, transparent reporting of AR functionalities, long-term skill-retention follow-up, improved haptic feedback, and cost-effectiveness analysis.

Design Implications¶

Context¶

Requirements¶

• Standardized AR systems and training protocols
• Uniform evaluation metrics to reduce heterogeneity
• Transparent reporting, particularly regarding AR functionalities

Constraints¶

• Current evidence base: only four of twelve studies were eligible for quantitative analysis due to differing outcomes and training content

Target Learners¶

• medical students
• junior physicians
• surgical trainees

Target Learning Goals¶

• basic laparoscopic surgical skills
• long-term retention and transfer of surgical skills to real-world settings

Claims¶

• Effect of AR on OSATS Specific scores is uncertain due to high heterogeneity and publication bias [+W]
• Qualitative synthesis indicates AR shortens learning curves, reduces errors, and differentiates proficiency levels in laparoscopic training [+W]
• AR reduces reliance on instructor supervision and enables autonomous laparoscopic practice [+W]
• AR-assisted training improves GOALS Global scores in novice laparoscopic learners [+W]
• AR-assisted training improves OSATS Global scores in novice laparoscopic learners [+W]
• AR-assisted training reduces subjective workload (NASA-TLX) in novice learners [+W]

Related Strategies¶

• Prioritize multicenter, randomized designs with standardized reporting and longitudinal follow-up in future surgical education research
• Prioritize longitudinal studies tracking trainees from simulation to real-world surgical performance
• Recommendation: evaluate PBL effectiveness through multicenter primary studies comparing educational centers, cultures, and psychological adaptation factors
• Strengthen vascular simulation research with modern validity frameworks, longer skill-retention follow-up, cost-effectiveness analysis, and more nontechnical-skills and cadaver models
• Prioritize randomized controlled trials, established validity frameworks, and protocol publication in future VRS simulation research

Examples¶

-

Key Sources¶

• Xiong Jian, Dai Xiaoqin, Zhang Yuyang, Liu Xingchao, Zhou Xiyuan. (2024). Augmented reality for basic skills training in laparoscopic surgery: a systematic review and meta-analysis. Surgical Endoscopy. https://doi.org/10.1007/s00464-024-11387-5