A five-level moderator-theme classification improves model fit and explains systematic variation in moderator effect sizes, with disciplinary focus yielding the largest and design/quality the smallest expected effects¶

Claim · All claims
Evidence · 1 study (2 entries) · quant-synthesis r3 · q3 · i2 medium
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q3 i? Introducing moderator theme as a five-level categorical predictor markedly improved model fit (posterior inclusion probability = 0.997; BFInc = 350) and reduced residual heterogeneity to τ = 0.44. → Bicakci 2026 q3 i2 Disciplinary focus yielded the largest expected moderator effects (g = 0.438) and design/quality the smallest (g = 0.197) among the five themes. → Bicakci 2026 (2)

Evidence¶

Bicakci 2026¶

Bicakci, M., Heller, F., Stoeger, H., & Ziegler, A. (2026). From RAMSing to Rigor: Improving Moderator Analysis in STEM Education Meta-Research. Educational Psychology Review. https://doi.org/10.1007/s10648-026-10172-1

q3 · i? · quant-synthesis · r3

RoBMA-Regression on the 1,786-effect-size corpus with moderator theme as a five-level categorical predictor; residual heterogeneity decreased to "τ = 0.44, 95% CrI [0.41, 0.47]" but substantial heterogeneity remained.

"Introducing moderator theme as a five-level categorical predictor markedly improved model fit (posterior inclusion probability = 0.997; BF Inc = 350), providing very strong evidence that the five-theme classification explained systematic varia tion rather than noise."

Bicakci 2026 (2)¶

q3 · i2 · quant-synthesis · r3

Model-averaged marginal estimates (Table 3): disciplinary focus g = 0.438, sample/context g = 0.364, publication metadata g = 0.275, intervention specifications g = 0.263, design/quality g = 0.197; the disciplinary-focus increment was "about + 0.13 relative to the overall baseline".

"Overall, the five-theme classification revealed a clear pattern: disciplinary focus yielded the largest expected moderator effects, whereas design/quality yielded the smallest."

Discussion¶

Science-related subject areas (mathematics, science, medical science) show larger effects than programming technology and other fields — related

Page metadata

Field	Value
`type`	`claim`
`id`	`five-theme-moderator-classification-stem`
`title`	`A five-level moderator-theme classification improves model fit and explains systematic variation in moderator effect sizes, with disciplinary focus yielding the largest and design/quality the smallest expected effects`
`description`	`A five-level moderator-theme classification improves model fit and explains systematic variation in moderator effect sizes, with disciplinary focus yielding the largest and design/quality the smallest expected effects`
`status`	`review`
`evidence_strength`	`moderate`
`newest_evidence`	`2026`
`generated`	by `process:wiki-ingest` on `2026-10-21`
`trust`	unverified — no one has confirmed this page's content
`sources`	2 — `bicakci-2026`, `bicakci-2026-2`

Frontmatter is the page's machine-readable record — see the Schema & Guide.