Angoff and Modified Angoff standard-setting show good inter-rater reliability in dental education, with reported coefficients ranging from 0.65 to 0.94¶
Claim · All claims
Evidence · 1 study · reviewr3·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Inter-rater reliability for the Angoff standard-setting process varied from 0.65 to 0.88 across included studies, and one study reported an ICC and Cronbach's alpha of 0.94. → Lin Galvin Sim Siang 2026
Evidence¶
Lin Galvin Sim Siang 2026¶
Lin Galvin Sim Siang, Hisham Abdul Rauf Badrul, Majid Muhammad Nazmi Abdul, Foong Chan Choong, Ho Ting Khee, Friedlander Lara T. (2026). Refining competency benchmarks: a scoping review of Angoff standard-setting in dental education. BMC Oral Health. https://doi.org/10.1186/s12903-026-08195-9
q2 · i? · review · r3
The review's synthesis of reliability findings across included primary studies reports that inter-rater reliability "varied from 0.65 to 0.88, indicating good agreement among the panels". One included study (Abd-Rahman et al.) additionally reported an ICC and Cronbach's alpha of 0.94, and Dalum et al. reported correlation coefficients of 0.69 to 0.77.
"Indeed, the inter-rater reliability for the Angoff standard-setting process varied from 0.65 to 0.88, indicating good agreement among the panels [32, 33]."
Discussion¶
Related Claims¶
- Percentage rating format in the Modified Angoff method yields higher reliability than the Yes/No format, with ICCs of 0.48–0.65 versus a maximum of 0.41 — related
- The Angoff method produced lower cut-off scores and higher pass rates than Cohen and Hofstee methods in dental written assessments, especially in early and middle years — related
- Rubrics enhance grading consistency and inter-rater reliability in dental education assessment — related
- Modified Angoff with reality check achieves excellent inter-rater reliability — a narrower finding that bears on this claim
- The Modified Angoff method was acceptable for setting different pass marks for senior and junior residents on the same OSCE — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.