Structured oral examinations show higher reliability than traditional formats, with median Cronbach's alpha of 0.75 across studies¶

Claim · All claims
Evidence · 1 study · review r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Across the 102 included studies, structured oral examination formats consistently outperformed traditional unstructured formats on reliability, with Cronbach's alpha ranging from 0.52 to 0.99 (median 0.75) and inter-rater reliability (kappa/ICC) of 0.47–0.82, improving after standardization or examiner training. → Torab-Miandoab A 2026

Evidence¶

Torab-Miandoab A 2026¶

Torab-Miandoab A, Ghafourifard M, Habibi-Chenaran S, Ghaffarifar S. (2026). Structured approaches to improving outcomes of oral exam in medical and paramedical education: A systematic review and evidence-based framework. PLoS One. https://doi.org/10.1371/journal.pone.0355461

q2 · i? · review · r2

Systematic review synthesis of reliability data across the 102 included studies of oral examinations in medical and paramedical education. The review reports "structured formats consistently outperforming traditional ones" with a median alpha of 0.75 for SOEs; inter-rater reliability (kappa = 0.47–0.82) improved post-standardization or examiner training (from 0.49 to 0.82).

"Reliability emerged as a central concern, with structured formats consistently outperforming traditional ones. Cronbach's alpha values ranged from 0.52 to 0.99 across studies, with a median of 0.75 indicating moderate to high internal consistency for SOEs."

Discussion¶

Related Claims¶

• Student and examiner satisfaction is high for structured and virtual oral formats (72–96% agreement), with preference for SOEs over traditional viva — related
• Examiner training and standardization are the most recommended solutions, and structured/mock formats show improved inter-rater reliability (kappa > 0.70) — related
• Examiner variability (66.7% of studies) and student anxiety (41.2%) are the most frequently reported challenges of oral examinations — related
• Standardized personal statements and letters of recommendation improve inter-rater reliability and mitigate bias — a narrower finding that bears on this claim
• Structured viva shows higher internal consistency reliability (Cronbach alpha 0.75–0.80) than traditional viva (alpha 0.50) — a narrower finding that bears on this claim
• Structured viva shows significant inter-rater reliability between examiner pairs (r = 0.78 to 0.91) and high inter-rater agreement (86.7%) — a narrower finding that bears on this claim