Open response format is associated with higher Alpha than multiple choice in knowledge tests¶
Claim · All claims
Evidence · 1 study · quant-synthesisr3·q3
Currency · newest study 2025 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Open response knowledge tests show higher meta-analytic Alpha (0.89) than multiple choice tests (0.79). → Peter A. Edelsbrunner 2025
Evidence¶
Peter A. Edelsbrunner 2025¶
Peter A. Edelsbrunner, Bianca A. Simonsmeier, Michael Schneider. (2025). The Cronbach’s Alpha of Domain‑Specific Knowledge Tests Before and After Learning: A Meta‑Analysis of Published Studies. Educational Psychology Review. https://doi.org/10.1007/s10648-024-09982-y
q3 · i? · quant-synthesis · r3
Meta-regression from Table 2 controlling for log-centered test length. Open answer tests (Alpha = .89, 90% CI [.85, .92]) showed higher Alpha than multiple choice (Alpha = .79, 90% CI [.75, .83]), p = .001. Table 1 summarizes: "Open response highest."
"Multiple choice 33 99 .79 [.75, .83] [.29, .94] ref 0.68 98.56 Open answer 19 99 .89 [.85, .92] [.61, .97] .001 0.70 98.25"
Discussion¶
Related Claims¶
- Cronbach's Alphas of knowledge tests vary widely, with a 90% prediction interval of (0.35, 0.96) — related
- Meta-analytic average Cronbach's Alpha of domain-specific knowledge tests is 0.85 with expected item intercorrelation of 0.22 — related
- Alpha of knowledge tests is substantially related to the number of items in the test — related
- The multiple-choice component of the revised ELA placement test strongly measured overall ELA performance, but few items strongly measured the three specific ELA domains — related
- Alpha is negatively related to sample mean age, and knowledge type shows no effect after controlling for test length — related
- Alpha of knowledge tests is higher for language and mathematics than for science and social sciences/humanities — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
knowledge-test-alpha-response-format |
title |
Open response format is associated with higher Alpha than multiple choice in knowledge tests |
description |
Open response format is associated with higher Alpha than multiple choice in knowledge tests |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2025 |
source_checked |
2026-10-20 |
generated |
by process:wiki-ingest on 2026-10-19 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — peter-a-edelsbrunner-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.