HMH Personal Math Trainer use was associated with math gains in grades 4, 5, and 8 but negatively associated in grade 7, and teacher-created assignments showed the strongest association¶

Claim · All claims
Evidence · 1 study (2 entries) · associational r2 · q2
Currency · newest study 2018 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Frequency of HMH Go Math/Personal Math Trainer use among PLI classes was associated with SBAC math gains in grades 4, 5 and 8 but negatively associated with outcomes in 7th grade. → Peters 2018 q2 i? Among Personal Math Trainer features, teacher-created math assignments had the strongest association with higher achievement. → Peters 2018 (2)

Evidence¶

Peters 2018¶

Peters, V., Means, B., Langworthy, M., Neufeld, P., Coe, R., Meehan, K., & Smith, S. (2018). Enabling Analytics for Improvement: Lessons from Year 2 of Fresno's Personalized Learning Initiative. Digital Promise. https://digitalpromise.dspacedirect.org/items/f5ad25ac-1bc9-4a05-9a4e-24c25ab19e8d doi:10.51388/20.500.12265/53

q2 · i? · associational · r2

Analysis of one month of HMH use versus SBAC math scores for PLI students by grade (Figure 5, PLI n = 6,435). The report attributes the negative grade 7 association to a smaller teacher sample (n = 674, 353 fewer than the next smallest).

"frequency of use of HMH's Go Math/Personal Math Trainer among PLI classes in grades 2-8 is associated with gains in SBAC scores in math in grades 4, 5 and 8, though it is negatively associated with outcomes in 7th grade where the number of teachers using the software was smaller than in other grades."

Peters 2018 (2)¶

Peters, V., Means, B., Langworthy, M., Neufeld, P., Coe, R., Meehan, K., & Smith, S. (2018). Enabling Analytics for Improvement: Lessons from Year 2 of Fresno's Personalized Learning Initiative. Digital Promise. https://digitalpromise.dspacedirect.org/items/f5ad25ac-1bc9-4a05-9a4e-24c25ab19e8d. doi:10.51388/20.500.12265/53

q2 · i? · associational · r2

Deeper analysis of HMH usage data (Figure 6) comparing feature types; the report states teacher-created assignments, in which teachers customize math content, show the strongest association with achievement. No effect size is printed.

"Among the variety of features in HMH's Personal Math Trainer (e.g. homework, tests and quizzes, daily interventions, and teacher-created assignments, etc.), the "teacher-created" math assignments have the strongest association with higher achievement."

Discussion¶

Related Claims¶

• PLI students outscored non-PLI peers on adjusted SBAC ELA and math assessments in most tested elementary and middle grades — a broader claim this one bears on
• Achievement gains were highest for PLI Exemplar teachers, while PLI Partner school teachers' gains were not higher than non-PLI teachers districtwide — related
• Students whose teachers attended one or two PLI professional learning courses gained more on SBAC, with larger gains for two sessions than one — related
• PLI students digitally collaborated significantly more than non-PLI students with the same technology access, and digital collaboration had a small significant association with SBAC scores — related
• PLI was associated with positive SBAC gains for African American, Hispanic, and Asian elementary students and no negative impact on any ethnic group — related
• Principals' access to professional development is positively related to student gains in both ELA and mathematics, with the strongest and most consistent relationships in mathematics — related