Label-effect sizes are highly heterogeneous, with variance split between and within studies¶

Claim · All claims
Evidence · 1 study · quant-synthesis r3 · q4
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q4 i? Effect sizes vary considerably between studies and between effects within studies, justifying a three-level multilevel model; roughly 82% of studies and effects are expected to be negative under normality. → Franz 2023

Evidence¶

Franz 2023¶

Franz, D. J., Richter, T., Lenhard, W., Marx, P., Stein, R., & Ratz, C. (2023). The Influence of Diagnostic Labels on the Evaluation of Students: a Multilevel Meta-Analysis. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09716-6

q4 · i? · quant-synthesis · r3

Heterogeneity analysis within the same multilevel meta-analysis of 284 effects. The authors report "considerable variability of effect sizes between studies and effects" and estimate that 7.15% of variance is sampling variance, 45.59% between effects within studies, and 47.26% between studies.

"The overall test of heterogeneity was significant, Q(284) = 2,307.87, p < .001, indicating considerable variability of effect sizes between studies and effects."

Discussion¶

Related Claims¶

• Diagnostic labels cause a moderately negative overall effect on how adults evaluate children (g = −0.42) — related
• Effects of AI literacy interventions vary considerably across contexts, with most variance between studies (71.361%) and a wide prediction interval — related
• Effect sizes vary widely between studies and especially between comparisons within studies — related
• Persistence varies both within and between students, warranting multilevel modeling, and level-1 predictors explained 18% of variance — related
• Effect sizes for gender differences in L2 achievement are highly heterogeneous across studies (I² = 89.82%) — related