No included WBA feedback study demonstrated improved learning and performance as a direct result of WBA (Kirkpatrick Level 4); the highest level reached was Level 3¶

Claim · All claims
Evidence · 1 study · review r3 · q2
Currency · newest study 2012 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? None of the 15 included studies showed an improvement in learning and performance as a direct result of WBA at Kirkpatrick Level 4; studies reached Levels 2 and 3. → Saedon H 2012

Evidence¶

Saedon H 2012¶

Saedon H, Salleh S, Balakrishnan A, Imray CHE, Saedon M. (2012). The role of feedback in improving the effectiveness of workplace based assessments: a systematic review. BMC Medical Education, 12, 25. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3432628/

q2 · i? · review · r3

Narrative synthesis of the 15 included studies, grouped by Kirkpatrick's four levels of educational outcomes. The review reports that studies "showed a modification of skills and attitudes or behavioural or willingness of learners to apply new knowledge & skills (Kirkpatrick Levels 2 and 3)" and none reached Level 4.

"They all showed a modification of skills and attitudes or behavioural or willingness of learners to apply new knowledge & skills (Kirkpatrick Levels 2 and 3) [6]. None of the studies showed an improvement in learning and performance as a direct result of WBA (Kirkpatrick Level 4)."

Discussion¶

Related Claims¶

• Reviewed peer-tutoring simulation studies mostly reached only Kirkpatrick Level 2, with no assessment of behavior change or clinical-practice results — related
• No included SDL studies measured Kirkpatrick Level 4 (patient/system) outcomes — a broader claim this one bears on
• Included orthodontic simulation studies evaluated outcomes only at Kirkpatrick reaction and learning levels, never at behaviour or results levels — related
• Evidence for mental practice impacts in surgery does not exceed Kirkpatrick level 3, and no study reported system-level (level 4) change — a broader claim this one bears on
• Four reviewed studies showed e-learning changed student study behaviour, including increased time invested in studying course subjects — reports the opposite
• Evidence on transfer to clinical behavior and patient outcomes is scarce: only 2 studies reached Kirkpatrick level 3 and 1 reached level 4 — a broader claim this one bears on
• E-learning interventions for registered nurses in continuing education are evaluated almost exclusively at Kirkpatrick levels 1 and 2, with no reported outcomes on practice change and almost none on patient outcomes — related
• Simulation-based education studies in pediatric and neonatal critical care more consistently report system-level process improvements (Level 4a) than significant direct patient-level outcome improvements (Level 4b) — reports the opposite