No current technical skills-assessment tool in orthopaedic surgical training fulfills accepted criteria for effective assessment¶
Claim · All claims
Evidence · 1 study · reviewr3·q3
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2023: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? The review concludes that none of the tools currently used for assessing technical skill in orthopaedic surgical training fulfill the criteria of Norcini et al. for effective assessment. → James H.K. 2020
Evidence¶
James H.K. 2020¶
James H.K., Chapman A.W., Pattison G.T.R., Fisher J.D., Griffin D.R. (2020). Analysis of Tools Used in Assessing Technical Skills and Operative Competence in Trauma and Orthopaedic Surgical Training: A Systematic Review. JBJS Reviews. https://doi.org/10.2106/JBJS.RVW.19.00167
q3 · i? · review · r3
The review's own synthesis across the 105 included studies, appraised against the utility index criteria. The authors state that "none of the tools currently used" fulfill the Norcini et al. criteria, and note a similar deficiency of utility evidence in general and vascular surgery.
"The results show that none of the tools currently used for assessing technical skill in orthopaedic surgical training fulfill the criteria of Norcini et al. for effective assessment112."
Discussion¶
Related Claims¶
- The 105 included studies of orthopaedic technical-skills assessment were predominantly conducted in simulated settings with 2,088 resident participants
- The Procedure Based Assessment shows poor engagement and deficient orthopaedic utility evidence, and the authors propose it is no longer appropriate for summative assessment — related
- Hybrid tools combining checklists with global rating scales (ASSET, OSATS) show promise but require further validation in the live operative theater — related
- Global rating scales discriminate between performance levels without a ceiling effect, making them useful for high-stakes summative assessment of advanced residents — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-11-01 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.