Effect size estimates for hands-on science interventions are highly heterogeneous across studies¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q3
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Heterogeneity across the 19 effect size estimates is statistically significant and very large (Q(18) = 175.12, p < .01; I2 = 90.45%). → Caglak 2017

Evidence¶

Caglak 2017¶

Caglak, S. (2017). Does hands-on science practices make an ımpact on achievement in science? A meta-analysis. Journal of Education in Science, Environment and Health (JESEH), 3(1), 69-87. https://eric.ed.gov/?id=EJ1125775

q3 · i? · quant-synthesis · r2

Heterogeneity analysis of the 19 included effect size estimates using the Q-statistic, I2 and H2 indices. The article reports "a great amount of heterogeneity" with Q(18) = 175.12, p < .01, and states the I2 value showed 90.45% of total variability was due to heterogeneity.

"Our data analysis showed that there was a great amount of heterogeneity in the observed effect size estimates obtained from the selected studies [Q (18) = 175.12, p < .01]."

Discussion¶

Related Claims¶

• Effects of game-based learning in STEM education vary substantially across studies, with prediction intervals spanning trivial-to-negative through very strong effects — a broader claim this one bears on
• Effect sizes across studies show substantial heterogeneity, with wide prediction intervals spanning large negative to large positive true effects — a broader claim this one bears on
• Emerging technologies show a small-to-moderate positive overall effect on TEFL outcomes (g = 0.38, corrected to 0.28 for publication bias) — related
• Effect sizes across the included studies are highly heterogeneous (I² = 91.37%), indicating moderating factors — related
• Between-study heterogeneity in LLM dental-question accuracy is very high (I² = 91.5%), with a prediction interval spanning 29.65% to 91.71% — related