Educational interventions for FM residents targeting the informal curriculum rarely produced behavior change: most were evaluated only at Kirkpatrick level 2 and study quality was low¶

Claim · All claims
Evidence · 1 study · review r2 · q3
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Of 11 included intervention studies, 10 were evaluated at Kirkpatrick level 2 (modification of attitudes/perceptions/knowledge/skills) and only 1 at level 3 (change in behavior); none reached level 4. → Rothlind Erica 2020 q3 i? BEME strength-of-findings ratings were low: mean and median score 2, with no study rated 4 or 5. → Rothlind Erica 2020

Evidence¶

Rothlind Erica 2020¶

Rothlind Erica, Fors Uno, Salminen Helena, Wändell Per, Ekblad Solvig. (2020). The informal curriculum of family medicine – what does it entail and how is it taught to residents? A systematic review. BMC Family Practice. https://doi.org/10.1186/s12875-020-01120-1

q3 · i? · review · r2

Systematic review assessment of 11 included interventions using Kirkpatrick's hierarchy and the BEME classification scale (Table 1): 10 curricula at level 2, 1 at level 3, 0 at levels 1 and 4; BEME strength ratings of 3, 3, and 5 studies at levels 1–3 respectively. No effect size printed.

"There was only one study where a change in behavior could be observed [47], the remaining studies only dealt with learning in terms of perceived modification of attitudes/perceptions/knowledge or skills [17, 43–46, 48–52]. The mean score was 2, and the median was 2."

Discussion¶

Related Claims¶

• All five pre-defined-curriculum WhatsApp studies assessed Kirkpatrick level 2 knowledge outcomes, while a majority of remaining studies reported only level 1 attitudes
• Outcome evaluation of research education programs concentrated at lower levels of the modified Kirkpatrick typology, with few objective or organisational outcomes
• Reviewed peer-tutoring simulation studies mostly reached only Kirkpatrick Level 2, with no assessment of behavior change or clinical-practice results
• Cultural competence in Family Medicine is largely agreed to be gained informally, and a large U.S. survey found most residency programs identify it as part of the informal curriculum — related
• Most included trials were conducted in simulated settings at Kirkpatrick evaluation level two, which may limit application to routine clinical practice — related
• E-learning interventions for registered nurses in continuing education are evaluated almost exclusively at Kirkpatrick levels 1 and 2, with no reported outcomes on practice change and almost none on patient outcomes — related
• Video review improves patient outcomes (Kirkpatrick level 4) in the single study reporting this level — related
• Limited evidence suggests PBL participants implement practice changes, but behavior-change data are sparse and mostly non-significant — related
• Four reviewed studies showed e-learning changed student study behaviour, including increased time invested in studying course subjects — related