Use cluster randomized clinical trials and blinded simulation-based behavior assessment to strengthen NTS training evidence¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The review recommends methodological improvements for future NTS training evaluations. The authors state that "cluster randomised clinical trials may help to draw more reliable conclusions about the effectivness of training interventions, providing a higher level of certainty to the evidence." They also note that behavior assessment can use "a controlled enviroment, such as simulation training, which allows for video recording and independent, blinded assessment."

Design Implications¶

Context¶

Requirements¶

• Larger sample sizes for cluster randomized designs
• Simulation environments enabling video recording and independent blinded assessors

Constraints¶

• Cluster randomized trials require a much larger sample size than before-and-after designs

Target Learners¶

• ICU healthcare professionals

Target Learning Goals¶

• Non-technical skills training effectiveness evaluation

Related Strategies¶

• Adopt cluster-randomised or stepped-wedge trial designs with blinded, video-based assessment and pre-defined process and patient endpoints in future NTS training research.
• Future active-learning research should use randomised controlled designs with larger samples and standardised outcome measures
• Future HFS trials for practising nurses need larger samples, rigorous randomised design and standardised, fully reported measures
• Prioritize rigorous RCTs with retention tests and transfer measures before expanding distance simulation programs
• Future research should use standardized validated outcome measures, longitudinal follow-up designs, and methods linking learner gains to patient-relevant outcomes
• Future simulation research should use rigorous designs, standardized tools, and transparent reporting
• Future research should include long-term RCTs with adequate sample sizes, standardized outcome measures, and cost-effectiveness analyses
• Methodological recommendations for future clinical reasoning education studies: report effect sizes with confidence intervals, control confounders, use ITT analysis, and determine MCID
• Prioritize rigorous VR training studies with larger samples, validated outcome measures, immersive designs, and LLM integration in mental health education research
• Adopt better methodologies and validated tools for identifying long-term EBP competency retention and for measuring attitude change

Examples¶

-

Key Sources¶

• Fernandes Pimenta Isac Davidson Santiago et al. (2025). Effectiveness of non-technical skills training in intensive care units: a systematic review. BMC Medical Education. https://doi.org/10.1186/s12909-025-07037-6