Aggregated effect sizes differ by outcome type: behavior highest (g = 2.38), performance large (g = 0.91), motivation small and negative (g = -0.39), none statistically significant¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q2 · i3 large
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i3 Behavior outcomes showed the highest aggregated effect size (g = 2.38, Vg = 0.10), performance showed a large effect (g = 0.91, Vg = 0.08), and motivation showed a small negative effect (g = -0.39, Vg = 0.04). → Kelly C. Dreger 2022 q2 i? None of the outcome-category effect sizes was statistically significant overall (p = 0.24), though heterogeneity was 96.54%. → Kelly C. Dreger 2022

Evidence¶

Kelly C. Dreger 2022¶

Kelly C. Dreger, Ed.D. and Steve Downey, Ph.D. (2022). Reinforcement Practicality for Middle School Students: A Meta-Analysis. Valdosta State University. https://eric.ed.gov/?id=EJ1355660

q2 · i3 · quant-synthesis · r2

Aggregation of the 31 studies' effect sizes by outcome category (Performance, Behavior, Motivation) in R. The article reports behavior at "g = 2.38", performance at g = 0.91, and motivation at g = -0.39, with an overall test at p = 0.24 and 96.54% heterogeneity.

"Behavior had an approximated effect size where g = 2.38 and a variance where Vg = 0.10. This effect size and variance was the highest of the three outcome categories."

Discussion¶

Related Claims¶

• Five moderators of token reinforcement effect sizes: study type, outcome type, effect size direction, publication year, and variance — related
• Gamification has small positive effects on cognitive, motivational and behavioral learning outcomes — related
• The overall effect size for token reinforcement interventions in middle schools is large (g ≈ 1.04) but not statistically significant — related
• 61.29% of studies showed positive effects of token reinforcement, but only 6.45% had sample sizes sufficient for generalizable large effects — related
• Reporting and publication bias pervade the token reinforcement literature: 38.71% of studies reported large significant effects while 29.03% lacked statistical significance — related
• SDL effects are stronger for knowledge/test outcomes than for clinical performance or behavioral outcomes — related