Angoff (Yes/No) variant shows the highest variability in cut scores¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The Angoff (Yes/No) variant demonstrated the highest variability in cut scores (mean = 69.6%, SD = 18.8), indicating its cut scores are highly inconsistent and context dependent. → Kannan 2025

Evidence¶

Kannan 2025¶

Kannan, S., & Gowri, S. (2025). Angoff methods in standard setting in health professional education: a systematic review and meta-analysis. BMC Medical Education, 25, 1727. doi:10.1186/s12909-025-08300-6

q2 · i? · quant-synthesis · r2

Sensitivity analyses (leave-one-out) assessed the statistical variability of cut scores for each variant. The Angoff (Yes/No) variant "demonstrated the highest variability (mean = 69.6%, SD = 18.8)".

"Regarding the cut scores (Fig. 7A), the Angoff (Yes/No) variant demonstrated the highest variability (mean = 69.6%, SD = 18.8), indicating its cut scores are highly inconsistent and context dependent."

Discussion¶

Related Claims¶

• Percentage rating format in the Modified Angoff method yields higher reliability than the Yes/No format, with ICCs of 0.48–0.65 versus a maximum of 0.41 — related
• Modified Angoff with reality check achieves excellent inter-rater reliability — related
• Mastery Angoff produces the highest cut scores and lowest pass rates among Angoff variants — related
• Number of judges positively influences cut scores, while test length influences pass rates