ASSISTments use in seventh grade produces a statistically significant long-term math achievement effect of 0.10 SD one year after implementation ends¶

Claim · All claims
Evidence · 1 study · causal r3 · q3 · i1 small
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i1 Intervention students scored 0.8 points higher than comparison students on the eighth-grade EOG math test, an effect size of 0.10 (Hedges's g), sustained one year after the program ended. → Feng 2024

Evidence¶

Feng 2024¶

Feng, M., Weiser, G., & Collins, K. (2024). Cost and cost effectiveness of ASSISTments online math support: Analysis from a randomized controlled study in middle school. WestEd. https://eric.ed.gov/?id=ED655721

q3 · i1 · causal · r3

Intent-to-treat impact analysis from the ASSISTments North Carolina replication RCT, following a preregistered analysis plan. The analytic sample was 5,991 students (2,961 intervention, 3,030 comparison); the reported difference corresponds to "an effect size of 0.10 (Hedges's g)".

"The analysis revealed that intervention group students scored higher (0.8 points) than comparison students on the EOG-MA08 test, with this difference being statistically significant (estimated mean score for intervention = 535.13, comparison = 534.33; p = 0.011)."

Discussion¶

Related Claims¶

• The cost-effectiveness ratio of ASSISTments is approximately $462.30 per student per standard deviation of long-term math achievement gain — related
• ASSISTments achieved a long-term effect comparable to high-dosage tutoring at a small fraction of the cost — related
• Implementing ASSISTments above business-as-usual cost about $207,794 across the study, or about $46.23 per student — related
• ASSISTments use for 7th-grade math homework significantly raises TerraNova mathematics scores in Maine (effect size +0.18) — related
• Brandt et al. (2013) finds a statistically significant positive effect of eMINTS on seventh- and eighth-grade mathematics achievement — related
• ASSISTments use in grade 7 math homework produces a statistically significant long-term positive effect on grade 8 state test scores one year after the intervention ends — possibly the same claim (merge candidate)
• NBA Math Hoops significantly improves elementary and middle school students' math achievement compared to business-as-usual summer STEM programming (0.19 SD gain) — related
• ASSISTments benefited Hispanic students more than non-Hispanic students — related
• Baseline equivalence held between conditions, but both groups scored far below the grade 8 proficiency cut score — related
• A teacher-coaching CAL program produces significant intent-to-treat gains in elementary and middle school math performance of 0.12-0.22 standard deviations — related
• Assigning schools to use RM-CC5 as their core Grade 5 mathematics curriculum for a full year did not significantly change state assessment achievement compared with business-as-usual schools — related
• In an IES-funded randomized controlled trial, students with lower prior mathematics achievement gained more from ASSISTments homework support than students with higher prior achievement — related