ASSISTments use in grade 7 math homework produces a statistically significant long-term positive effect on grade 8 state test scores one year after the intervention ends¶

Claim · All claims
Evidence · 1 study · causal r3 · q3 · i1 small
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i1 Students who used ASSISTments in grade 7 scored 0.8 points higher on the grade 8 EOG math test than comparison students (Hedges' g = 0.10, p = 0.011), one year after the intervention ended. → Feng 2023

Evidence¶

Feng 2023¶

Feng, M., Huang, C.-W., & Collins, K. (2023). Technology-based support shows promising long-term impact on math learning: Initial results from a randomized controlled trial in middle schools. WestEd. https://osf.io/exqpn

q3 · i1 · causal · r3

Intent-to-treat analysis of 5,991 students (2,961 intervention, 3,030 comparison) from 63 randomized schools, using two-level hierarchical linear regression with baseline MA06 covariates. The "estimated mean score on MA08 for the intervention group was 535.13" versus 534.33 for comparison, a 0.8-point difference.

"This treatment impact is statistically significant (p = 0.011) and corresponds to an effect size of 0.10 (Hedges' g). The results suggest that implementing ASSISTments had a significant positive impact on student learning in math in the long term."

Discussion¶

Related Claims¶

• Timely feedback on homework increases learning, and computer platforms providing immediate feedback help teachers adapt — the general claim this finding bears on, with the studies behind it
• ASSISTments use in seventh grade produces a statistically significant long-term math achievement effect of 0.10 SD one year after implementation ends — possibly the same claim (merge candidate)
• ASSISTments use for 7th-grade math homework significantly raises TerraNova mathematics scores in Maine (effect size +0.18) — related
• ASSISTments achieved a long-term effect comparable to high-dosage tutoring at a small fraction of the cost — related
• A North Carolina replication found ASSISTments 7th-grade use raised 8th-grade end-of-grade math scores (effect size +0.10) despite COVID-19 disruption — related
• ASSISTments benefited Hispanic students more than non-Hispanic students — related
• Baseline equivalence held between conditions, but both groups scored far below the grade 8 proficiency cut score — related
• In an IES-funded randomized controlled trial, students with lower prior mathematics achievement gained more from ASSISTments homework support than students with higher prior achievement — related