Ninth-grade on-track NSI positively affected GPA, core course pass rates, and credit completion after schools' second year of participation¶

Claim · All claims
Evidence · 2 studies · 2 causal r? · q3
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? After schools' second year, 9th-grade on-track NSI raised GPA by 0.13 points, core course passing by 4 percentage points, and five-credit attainment by 4 percentage points. → Evaluation of the Networks for School Improvement Initiative: Interim Summary Report 2024

q3 i? After schools' second year of participation, the 9th-grade on-track NSI had a positive impact on three of the five outcomes: GPA, core course pass rate, and credit completion. → Matthew Johnson 2024

Evidence¶

Evaluation of the Networks for School Improvement Initiative: Interim Summary Report 2024¶

Evaluation of the Networks for School Improvement Initiative: Interim Summary Report. (2024). RAND Corporation. https://www.rand.org/pubs/research_reports/RRA242-1.html

q3 · i? · causal · r?

Matched comparison analysis of administrative student data comparing NSI schools with similar schools in the same district, reported in Research Question 3. The report states effects were "equivalent to a 0.13 point increase in GPA" plus the printed pass-rate and credit gains; no standardized effect size is printed.

"The effects of the 9th-grade on-track NSI were equivalent to a 0.13 point increase in GPA (from 2.34 to 2.47 on a 4.0 scale), a 4 percentage point increase in the share of core courses passed (from 65 percent to 69 percent), and a 4 percentage point increase in the share of 9th-grade students earning at least five credits (from 83 percent to 87 percent)."

Matthew Johnson 2024¶

Matthew Johnson, Jeffrey Max, Tareena Musaddiq, Breyon Williams, Silvia Robles, Michelle Bennett. (2024). Evaluation of the Networks for School Improvement Initiative: Impacts on Student Outcomes (Interim Report). Bill & Melinda Gates Foundation. https://www.mathematica.org/publications/evaluation-of-the-networks-for-school-improvement-initiative-student-outcomes-interim-report

q3 · i? · causal · r?

Quasi-experimental comparison of students in 9th-grade on-track NSI schools to students in similar non-participating schools after the second year. The report states these NSI "had a positive impact on three of the five outcomes"; no effect sizes are printed in the available text.

"These NSI had a positive impact on three of the five outcomes-GPA, core course pass rate, and credit completion-after schools' second year of participation"

Discussion¶

Related Claims¶

• After schools' second year of participation, the 8th-grade on-track NSI did not impact the targeted student outcomes — related
• The impact of the 9th-grade on-track NSI appeared to increase over time — related
• Eighth-grade on-track NSI showed no statistically significant impact on targeted outcomes after schools' second year, and year-1 impacts did not persist — related
• In the randomized Cohort 3 study, 9th-grade on-track NSI moderately improved attendance rates by 2 percentage points — related
• Network cohesion in NSI increased over time but remained low, with about 16 percent of possible school-to-school connections realized — related
• Improvements in ninth-grade course performance—credits earned, pass rates, and attendance—account for most graduation improvements beyond student background changes — related
• High schools that underwent reform showed no significant improvement in absence rates or ninth-grade on-track rates compared with matched schools — related
• 9th-grade on-track NSI improved GPA by about 0.11 points on a 4-point scale — related
• 9th-grade on-track NSI improved course pass rates by 3 to 4 percentage points but did not reduce suspension rates — related
• College-ready on-track NSI did not impact GPA, advanced course taking, math and ELA test scores, graduation, or college enrollment — related
• Chicago's graduation-rate improvements have been credited to changed ninth-grade dropout-prevention practices triggered by on-track accountability and real-time data reports, and the review states accountability by itself was not sufficient — related
• Lied magnet students in grades 6-8 attempted and completed significantly more STEM credits than matched comparison students — related
• Bronxdale students outperformed comparison-group, borough, and city high schools on graduation rates and on-track credit indicators in 2017–18 — related
• Students' attendance and middle grades on-track rates in Success schools improved during the first two program years, especially in Year 2 — related
• Success schools' student GPAs did not show much improvement in the first two years — related
• Six of seven recently reformed high schools showed first-year on-track improvements above comparison schools, though evidence is limited — related