No included SDL studies measured Kirkpatrick Level 4 (patient/system) outcomes¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Across 125 included studies, 78% measured Kirkpatrick Level 2 outcomes, 22% Level 3, and no studies (0%) measured Level 4 patient or system outcomes. → Wilkes S. 2026

Evidence¶

Wilkes S. 2026¶

Wilkes S., Maggio L. A., Martin P. C., Melton J., Zheng B. (2026). Self-Directed Learning in Health Professions Education: A Systematic Review and Meta-Analysis. Perspectives on Medical Education. https://doi.org/10.5334/pme.2128

q3 · i? · quant-synthesis · r2

Systematic characterization of outcome levels across all 125 included studies using the Kirkpatrick framework. The authors suggest the complete absence of Level 4 studies "may reflect the challenges in measuring patient or system-level outcomes in health professions education."

"In 98 studies, learning outcomes were categorized as Kirkpatrick level 2 outcomes, those that involve the measurement of knowledge or skills (typically through tests or formal assessments), while in 27 studies they were categorized as level 3, those that involve behavioral outcomes such as clinical performance. We did not identify any studies at Level 4"

Discussion¶

Related Claims¶

• Evidence for technology-enhanced basic robotic skills training is concentrated at Kirkpatrick level 2, with no studies reporting transfer to operative behaviour or patient outcomes — related
• Evidence on transfer to clinical behavior and patient outcomes is scarce: only 2 studies reached Kirkpatrick level 3 and 1 reached level 4 — related
• Competency-based simulation effects are large for skills measured in the simulation lab but small and non-significant for clinical behaviors and patient outcomes — related
• Simulation-based education studies in pediatric and neonatal critical care more consistently report system-level process improvements (Level 4a) than significant direct patient-level outcome improvements (Level 4b) — related
• No included comparative study assessed patient-based clinical outcomes, patient acceptability of care, or staff resource time — related
• Reviewed peer-tutoring simulation studies mostly reached only Kirkpatrick Level 2, with no assessment of behavior change or clinical-practice results — related
• Where cost was studied, AI-generated virtual patients showed savings from obviating faculty time and human standardized patients, but cost evaluation remains sparse and none reached Kirkpatrick level 4 — related
• SDL effects are stronger for knowledge/test outcomes than for clinical performance or behavioral outcomes — related
• Self-assessed abilities are uncorrelated with actual performance measures, and Kirkpatrick level 1 is generally not recommended — related