Effects of AI literacy interventions vary considerably across contexts, with most variance between studies (71.361%) and a wide prediction interval¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Substantial heterogeneity exists in AI literacy intervention effects, with 71.361% of variance at the between-study level and a 95% prediction interval from -0.292 to 1.966. → Suya Liu 2026

Evidence¶

Suya Liu 2026¶

Suya Liu, Ziyan Lin, Oi Lam Ng, Yijian Yang, Yun Dai. (2026). AI literacy interventions in education: A meta-analysis of effects and moderators. Educational Research Review. https://doi.org/10.1016/j.edurev.2026.100813

q3 · i? · quant-synthesis · r2

Heterogeneity assessment within the same three-level meta-analysis. All variance components were significant; the article reports variance shares of 5.144%, 23.495%, and 71.361% and a 95% prediction interval of [-0.292, 1.966], indicating effects "may vary considerably across studies and contexts".

"the Q test (Q (171) = 1896.404, p < .001), within-study variance (p < .001, Level 2), and between-study variance (p < .001, Level 3) were all statistically significant"

Discussion¶

Related Claims¶

• AI literacy interventions show a large, statistically significant overall positive effect on student AI literacy outcomes (g = 0.837) — the general claim this finding bears on, with the studies behind it
• The positive GenAI writing effect is robust across dependence-aware, sensitivity, and risk-of-bias specifications, but the wide prediction interval spans near-zero to large effects — related
• GenAI coding assistance produces a statistically significant moderate positive effect on developer productivity (g = 0.33), with substantial heterogeneity across settings. — related
• Included intervention studies varied considerably in design, methods, quality and transferability — related
• Design parameters for preschool outcomes show substantial heterogeneity across populations, as reflected in wide 95% prediction intervals — related
• Technology-supported educational interventions are associated with higher metacognitive outcomes on average (g = 0.653), with substantial between-study heterogeneity — related
• Effects of game-based learning in STEM education vary substantially across studies, with prediction intervals spanning trivial-to-negative through very strong effects — related
• Substantial unexplained heterogeneity characterises short-term effects of targeted K-6 interventions — related
• Effect sizes vary widely between studies and especially between comparisons within studies — related
• Label-effect sizes are highly heterogeneous, with variance split between and within studies — related
• Effect sizes across studies show substantial heterogeneity, with wide prediction intervals spanning large negative to large positive true effects — related
• Effect sizes for gender differences in L2 achievement are highly heterogeneous across studies (I² = 89.82%) — related