After schools' second year of participation, the 8th-grade on-track NSI did not impact the targeted student outcomes¶

Claim · All claims
Evidence · 1 study · causal r? · q3
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? The 8th-grade on-track NSI did not impact the targeted student outcomes after schools' second year of participation, despite impacting some outcomes in year one. → Matthew Johnson 2024

Evidence¶

Matthew Johnson 2024¶

Matthew Johnson, Jeffrey Max, Tareena Musaddiq, Breyon Williams, Silvia Robles, Michelle Bennett. (2024). Evaluation of the Networks for School Improvement Initiative: Impacts on Student Outcomes (Interim Report). Bill & Melinda Gates Foundation. https://www.mathematica.org/publications/evaluation-of-the-networks-for-school-improvement-initiative-student-outcomes-interim-report

q3 · i? · causal · r?

Quasi-experimental comparison of students in 8th-grade on-track NSI schools to students in similar non-participating schools, reported after schools' second year. The report states the NSI "did not impact the targeted student outcomes after schools' second year of participation." No effect sizes are printed in the available text.

"Although the 8th-grade on-track NSI had an impact on some outcomes in schools' first year, they did not impact the targeted student outcomes after schools' second year of participation."

Discussion¶

Related Claims¶

• Eighth-grade on-track NSI showed no statistically significant impact on targeted outcomes after schools' second year, and year-1 impacts did not persist — possibly the same claim (merge candidate)
• After schools' second year, the 9th-grade on-track NSI positively impacted GPA, core course pass rate, and credit completion — related
• The impact of the 9th-grade on-track NSI appeared to increase over time — related
• In the randomized Cohort 3 study, 9th-grade on-track NSI moderately improved attendance rates by 2 percentage points — related
• Students' attendance and middle grades on-track rates in Success schools improved during the first two program years, especially in Year 2 — related
• Success schools' student GPAs did not show much improvement in the first two years — related
• 8th-grade on-track NSI positively impacted math test scores, moving students from the 37th to the 40th percentile — related
• 8th-grade on-track NSI did not improve ELA test scores, attendance, or suspension rates — possibly the same claim (merge candidate)
• College-ready on-track NSI did not impact GPA, advanced course taking, math and ELA test scores, graduation, or college enrollment — related