Most included trials were conducted in simulated settings at Kirkpatrick evaluation level two, which may limit application to routine clinical practice¶

Claim · All claims
Evidence · 1 study · quant-synthesis r3 · q2
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Most included studies were conducted in a simulated environment at Kirkpatrick level two (change in skills), with only a few in authentic clinical practice at Kirkpatrick level three, which may limit application to routine clinical practice. → Johnson Christina Elizabeth 2020

Evidence¶

Johnson Christina Elizabeth 2020¶

Johnson Christina Elizabeth, Weerasuria Mihiri P, Keating Jennifer L. (2020). Effect of face-to-face verbal feedback compared with no or alternative feedback on the objective workplace task performance of health professionals: a systematic review and meta-analysis. BMJ Open. https://doi.org/10.1136/bmjopen-2019-030672

q2 · i? · quant-synthesis · r3

Review limitation stated in the Discussion: the review notes that most included trials assessed performance in simulated environments at "Kirkpatrick evaluation level two (change in skills)", with only a few in authentic clinical practice, which may limit generalisability to routine practice.

"Most included studies were conducted in a simulated environment, at Kirkpatrick evaluation level two (change in skills), with only a few situated in authentic clinical practice at Kirkpatrick level three (change in skills applied at work), which may limit application to routine clinical practice."

Discussion¶

Related Claims¶

• Reviewed peer-tutoring simulation studies mostly reached only Kirkpatrick Level 2, with no assessment of behavior change or clinical-practice results — a narrower finding that bears on this claim
• Korean simulation-based IPE studies report high satisfaction but concentrate on Kirkpatrick levels 1 and 2, with no study measuring level 4 training efficacy — related
• Educational interventions for FM residents targeting the informal curriculum rarely produced behavior change: most were evaluated only at Kirkpatrick level 2 and study quality was low — related
• Improved performance in the simulation environment may not transfer to real-life clinical settings, with almost no studies assessing translated clinical performance — possibly the same claim (merge candidate)