Evidence on transfer to clinical behavior and patient outcomes is scarce: only 2 studies reached Kirkpatrick level 3 and 1 reached level 4¶

Claim · All claims
Evidence · 1 study · review r3 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Only 2 of 104 studies evaluated physicians' behaviors (Kirkpatrick level 3), and a single study reported patient health care outcomes (level 4). → Wei W 2026

Evidence¶

Wei W 2026¶

Wei W, Nielsen MS, Nielsen AB, Han Y, Russell L, Konge L, Cold KM. (2026). Hands-on Distance Simulation of Technical Skills: A Systematic Review. Simulation in Healthcare. https://doi.org/10.1097/SIH.0000000000000881

q3 · i? · review · r3

Review synthesis using Kirkpatrick's framework across 104 studies; the review reports only 2 studies at level 3 (clinical intubation performance, telesupervised ultrasound scans) and 1 at level 4 (postoperative visual acuity after cataract surgery training).

"Only 2 studies involved physicians' behaviors (Kirkpatrick level 3, 2 points): one on intubation performance during clinical anesthesia29 and another on telesupervised ultrasound scans.31 A single study reported health care outcomes (Kirkpatrick level 4, 3 points) of patients' postoperative visual acuity following cataract surgery training32"

Discussion¶

Related Claims¶

• Training on a simple low-fidelity 'choose-the-hole' bench model transferred to real clinical fibreoptic intubation performance in an RCT — related
• Evidence for technology-enhanced basic robotic skills training is concentrated at Kirkpatrick level 2, with no studies reporting transfer to operative behaviour or patient outcomes — related
• Reviewed peer-tutoring simulation studies mostly reached only Kirkpatrick Level 2, with no assessment of behavior change or clinical-practice results — related
• Outcome evaluation of AI-generated virtual patients in HPE is concentrated at Kirkpatrick level 1, with no studies reporting level 3 or 4 outcomes — related
• Competency-based simulation effects are large for skills measured in the simulation lab but small and non-significant for clinical behaviors and patient outcomes — related
• In 18% (3/16) of included simulation studies, positive clinical trends did not reach statistical significance — related
• Kirkpatrick's four levels of evidence can be applied to RAS training, with level 2 equating to RAS skills assessed with validated scoring systems during simulation. — related
• No longitudinal studies or RCTs demonstrate that AI-acquired skills transfer to the operating room — a narrower finding that bears on this claim
• No included SDL studies measured Kirkpatrick Level 4 (patient/system) outcomes — related