NOTSS was the most used NTS tool with strong validity evidence, but self-assessment without validity evidence was the most frequent form of NTS assessment (n=78)¶

Claim · All claims
Evidence · 1 study · review r3 · q3
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person · recheck by 2027: tool and model accuracy changes quickly

Subclaims¶

q3 i? NOTSS was the most frequently used NTS tool (n=18), but self-assessment in various forms was the most frequently used form of assessment overall (n=78), often without validity evidence. → Gamborg ML 2024

Evidence¶

Gamborg ML 2024¶

Gamborg ML, Salling LB, Rölfing JD, Jensen RD. (2024). Training technical or non-technical skills: an arbitrary distinction? A scoping review. BMC Medical Education. https://doi.org/10.1186/s12909-024-06419-6

q3 · i? · review · r3

Synthesis of NTS assessment practices across the 203 included studies. The review reports "Self-assessment in various forms was the most frequently used form of assessment (n = 78)", most commonly self-reported confidence on Likert scales in pre- and post-evaluations. A total of 72 studies used tools with strong validity evidence for both TS and NTS.

"Self-assessment in various forms was the most frequently used form of assessment (n = 78) which was often used to assess the participants' NTS either in a survey or questionnaire."

Discussion¶

Related Claims¶

• OSATS was the most frequently used technical-skills assessment tool, but many OSATS variations were used without validity evidence — related
• NTS training programs in ICUs are associated with improved teamwork, situational awareness, leadership and communication behaviors, with varying evidence certainty — related
• Formative purpose dominates peer assessment studies, but summative purpose is relatively frequent in ICT, engineering, and health and welfare domains — related