Effect sizes vary widely between studies and especially between comparisons within studies¶

Claim · All claims
Evidence · 1 study · quant-synthesis r? · q3
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Large heterogeneity was observed in intervention effect sizes, especially between comparisons within studies. → Verhoeven 2022

Evidence¶

Verhoeven 2022¶

Verhoeven, L.T.W.; Voeten, M.J.M.; Segers, P.C.J. (2022). Computer-assisted word reading intervention effects throughout the primary grades: A meta-analysis. Educational Research Review, 37, article 100486. https://doi.org/10.1016/j.edurev.2022.100486

q3 · i? · quant-synthesis · r?

Heterogeneity observation from the multilevel meta-analysis of 694 effect sizes across 67 studies; the review reports "Large variation in effect sizes was observed between studies and especially between comparisons within studies". No heterogeneity statistic is printed in the available text.

"Large variation in effect sizes was observed between studies and especially between comparisons within studies."

Discussion¶

Related Claims¶

• Effects of AI literacy interventions vary considerably across contexts, with most variance between studies (71.361%) and a wide prediction interval — related
• Design parameters for preschool outcomes show substantial heterogeneity across populations, as reflected in wide 95% prediction intervals — related
• The positive GenAI writing effect is robust across dependence-aware, sensitivity, and risk-of-bias specifications, but the wide prediction interval spans near-zero to large effects — related
• Effects of game-based learning in STEM education vary substantially across studies, with prediction intervals spanning trivial-to-negative through very strong effects — related
• Technology-supported educational interventions are associated with higher metacognitive outcomes on average (g = 0.653), with substantial between-study heterogeneity — related
• Substantial unexplained heterogeneity characterises short-term effects of targeted K-6 interventions — related
• Label-effect sizes are highly heterogeneous, with variance split between and within studies — related
• Effect sizes across included studies show high heterogeneity (all I² above 75%) — related
• Effect sizes across studies show substantial heterogeneity, with wide prediction intervals spanning large negative to large positive true effects — related
• Effect sizes for gender differences in L2 achievement are highly heterogeneous across studies (I² = 89.82%) — related