Cronbach's alpha equals the reliability of the scale score under classical test theory, domain sampling, and generalizability theory, and should be interpreted as a reliability coefficient¶

Claim · All claims
Evidence · 1 study · theoretical r3 · q1
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q1 i? A derivation under the assumption of standardized parallel items shows alpha equals the ratio of true score variance to scale score variance, i.e., the reliability of the scale score. → Steffen Zitzmann 2025

Evidence¶

Steffen Zitzmann 2025¶

Steffen Zitzmann, Gabe A. Orona. (2025). Why We Might Still be Concerned About Low Cronbach's Alphas in Domain-specific Knowledge Tests. Educational Psychology Review. https://doi.org/10.1007/s10648-025-10015-5

q1 · i? · theoretical · r3

Analytical derivation in the commentary: assuming standardized parallel items, alpha is algebraically reduced to the true-score-variance-to-scale-score-variance ratio, which "is exactly what a reliability coefficient is expected to do (Cho, 2016)" under classical test theory, domain sampling, and generalizability theory.

"This ratio compares the amount of true score variance to the scale score variance, which is exactly what a reliability coefficient is expected to do (Cho, 2016)."

Discussion¶

Related Claims¶

• Adding items to a knowledge test can increase reliability without requiring the added items to be redundant with existing items — related
• Theoretically defined test reliability computable from a single administration via parallel-half vector lengths and angle exceeds split-half reliability but falls below Cronbach alpha — related
• A high Cronbach's alpha across items measuring distinct knowledge aspects indicates the test is not working as intended — related
• Meta-analytic average Cronbach's Alpha of domain-specific knowledge tests is 0.85 with expected item intercorrelation of 0.22 — related