Alpha of knowledge tests is higher for language and mathematics than for science and social sciences/humanities¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q3
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q3 i? Language tests show higher Alpha (.87, p = .003) than science (.76), while mathematics (.83) did not differ significantly from science. → Peter A. Edelsbrunner 2025

Evidence¶

Peter A. Edelsbrunner 2025¶

Peter A. Edelsbrunner, Bianca A. Simonsmeier, Michael Schneider. (2025). The Cronbach’s Alpha of Domain‑Specific Knowledge Tests Before and After Learning: A Meta‑Analysis of Published Studies. Educational Psychology Review. https://doi.org/10.1007/s10648-024-09982-y

q3 · i? · quant-synthesis · r2

Meta-regression from Table 2 controlling for log-centered test length. Language tests (.87, p = .003) exceeded science (.76); mathematics (.83, p = .235) and social sciences/humanities (.77, p = .750) did not differ significantly from science. Table 1: "Highest estimates for mathematics and language."

"Science 15 37 .76 [.68, .82] [.00, .95] ref 0.46 97.74 Social sciences ___/Humanities 5 22 .77 [.74, .80] [.02, .95] .750 0.18 95.57 Language 24 166 .87 [.83, .89] [.42, .97] .003 0.81 98.54 Mathematics 11 58 .83 [.73, .89] [.22, .96] .235 0.48 98.58"

Discussion¶

Related Claims¶

• Alpha is negatively related to sample mean age, and knowledge type shows no effect after controlling for test length — related
• Digital data use differs by teaching subject: STEM teachers report lower use than languages/arts/humanities and vocational teachers, and vocational teachers report the highest use — related
• Cronbach's Alphas of knowledge tests vary widely, with a 90% prediction interval of (0.35, 0.96) — related
• Meta-analytic average Cronbach's Alpha of domain-specific knowledge tests is 0.85 with expected item intercorrelation of 0.22 — related
• Stealth assessment facets show good internal consistency (Cronbach's alpha = 0.76) while MicroDYN reliabilities were low in this middle-school sample — related
• A pilot study (N = 10) established timed-administration parameters, showing high internal consistency and minimal speededness for the SCS1 12-item subset — related
• Open response format is associated with higher Alpha than multiple choice in knowledge tests — related
• Reliability estimates vary by region and instrument, with ARS showing α/ω = 0.90 and ABS α/ω = 0.82, and the evidence base geographically uneven — related