Global rating scales by expert practitioners are as reliable as item-specific checklists and less labour intensive to devise¶
Claim · All claims
Evidence · 1 study · reviewr2·q2
Currency · newest study 2012 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2015: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The review reports that global scoring tools used by expert practitioners are as reliable an assessment method as item specific checklists and considerably less labour intensive to devise. → Morris Marie C. 2012
Evidence¶
Morris Marie C. 2012¶
Morris Marie C., Gallagher Tom K., Ridgway Paul F. (2012). Tools used to assess medical students competence in procedural skills at the end of a primary medical degree: a systematic review. Medical Education Online. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3427596/
q2 · i? · review · r2
Narrative synthesis within the systematic review comparing the two assessment methods identified. The review states "the use of global scoring tools by expert practitioners is as reliable an assessment method as item specific checklists", citing the global tool's κ of 0.79.
"It appears from the literature that the use of global scoring tools by expert practitioners is as reliable an assessment method as item specific checklists; moreover, they are considerably less labour intensive to devise (Tables 3 and 4)."
Discussion¶
Related Claims¶
- Global rating scales discriminate between performance levels without a ceiling effect, making them useful for high-stakes summative assessment of advanced residents — related
- Hybrid tools combining checklists with global rating scales (ASSET, OSATS) show promise but require further validation in the live operative theater — related
- Checklists show reasonable validity and reliability but have an early ceiling effect and are most appropriate for novice learners in formative settings — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-11-01 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.