Contextual factors (learner level, discipline, format) moderate Angoff outcomes¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Outcomes are significantly moderated by learner level, academic discipline, and assessment format, with more lenient standards for undergraduates and OSCE formats, and stricter standards for postgraduates and dentistry. → Kannan 2025

Evidence¶

Kannan 2025¶

Kannan, S., & Gowri, S. (2025). Angoff methods in standard setting in health professional education: a systematic review and meta-analysis. BMC Medical Education, 25, 1727. doi:10.1186/s12909-025-08300-6

q2 · i? · quant-synthesis · r2

Subgroup analyses were performed according to discipline, item type, and learner level. The analysis found "a tendency towards more lenient standards (higher pass rates) with Angoff methods for undergraduate learners and in OSCE/OSPE formats" and "a trend towards stricter standards (lower pass rates) ... at the postgraduate level and within the dentistry discipline."

"The overarching pattern indicated a tendency towards more lenient standards (higher pass rates) with Angoff methods for undergraduate learners and in OSCE/OSPE formats. In contrast, a trend towards stricter standards (lower pass rates) was observed at the postgraduate level and within the dentistry discipline."

Discussion¶

Related Claims¶

• Percentage rating format in the Modified Angoff method yields higher reliability than the Yes/No format, with ICCs of 0.48–0.65 versus a maximum of 0.41 — related
• The Borderline Regression method produced higher OSCE pass rates than Angoff methods (97.5% vs 86.6%) and discrepancies raise concerns for small cohorts — related
• Angoff-derived cut-off scores exceeded the arbitrary 60% fixed passing mark, with one study reporting a 74.31% cut-off that would have produced a 41% failure rate — related
• The Angoff method produced lower cut-off scores and higher pass rates than Cohen and Hofstee methods in dental written assessments, especially in early and middle years — related
• Angoff methods produce significantly higher pass rates than conventional fixed standard-setting methods — related
• Number of judges positively influences cut scores, while test length influences pass rates
• The Modified Angoff method was acceptable for setting different pass marks for senior and junior residents on the same OSCE — related