Angoff methods produce significantly higher pass rates than conventional fixed standard-setting methods¶
Claim · All claims
Evidence · 1 study · quant-synthesisr2·q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Angoff methods produce significantly higher pass rates than conventional fixed standard-setting methods (OR: 7.48). → Kannan 2025
Evidence¶
Kannan 2025¶
Kannan, S., & Gowri, S. (2025). Angoff methods in standard setting in health professional education: a systematic review and meta-analysis. BMC Medical Education, 25, 1727. doi:10.1186/s12909-025-08300-6
q2 · i? · quant-synthesis · r2
A mixed treatment comparison meta-analysis of 21 studies (22,622 examinees) pooled pass rates from studies comparing Angoff variants against conventional fixed methods. The pooled estimate for Angoff was "OR: 7.48; 95% CI: 3.24–17.28".
"Mixed treatment comparison pooled estimates revealed significantly higher pass rates with Angoff (OR: 7.48; 95% CI: 3.24–17.28) and norm-referenced mean–2SD methods (OR: 1.79; 95% CI: 1.10–2.91)."
Discussion¶
Related Claims¶
- Angoff-derived cut-off scores exceeded the arbitrary 60% fixed passing mark, with one study reporting a 74.31% cut-off that would have produced a 41% failure rate — related
- The Angoff method produced lower cut-off scores and higher pass rates than Cohen and Hofstee methods in dental written assessments, especially in early and middle years — related
- Percentage rating format in the Modified Angoff method yields higher reliability than the Yes/No format, with ICCs of 0.48–0.65 versus a maximum of 0.41 — related
- The Borderline Regression method produced higher OSCE pass rates than Angoff methods (97.5% vs 86.6%) and discrepancies raise concerns for small cohorts — related
- Contextual factors (learner level, discipline, format) moderate Angoff outcomes — related
- Mastery Angoff produces the highest cut scores and lowest pass rates among Angoff variants — related
- Number of judges positively influences cut scores, while test length influences pass rates
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.