Eighth-grade on-track NSI showed no statistically significant impact on targeted outcomes after schools' second year, and year-1 impacts did not persist¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r2 · q3
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? After the second year of participation, 8th-grade on-track NSI did not significantly affect the targeted academic or behavioral outcomes. → Evaluation of the Networks for School Improvement Initiative: Interim Summary Report 2024 q3 i? Year-1 positive impacts on GPA, course pass rates, and attendance for 8th-grade on-track NSI were close to zero and not statistically significant by year 2. → Evaluation of the Networks for School Improvement Initiative: Interim Summary Report 2024 (2)

Evidence¶

Evaluation of the Networks for School Improvement Initiative: Interim Summary Report 2024¶

Evaluation of the Networks for School Improvement Initiative: Interim Summary Report. (2024). RAND Corporation. https://www.rand.org/pubs/research_reports/RRA242-1.html

q3 · i? · causal · r?

Matched comparison analysis in Research Question 3 comparing students in 8th-grade on-track NSI schools with students in similar within-district comparison schools on academic and behavioral outcomes; no statistically significant differences were found and no effect size is printed.

"Although there were small differences between NSI schools and comparison schools for the 8th-grade on-track NSI, these differences were not statistically significant."

Evaluation of the Networks for School Improvement Initiative: Interim Summary Report 2024 (2)¶

Evaluation of the Networks for School Improvement Initiative: Interim Summary Report. (2024). RAND Corporation. https://www.rand.org/pubs/research_reports/RRA242-1.html

q3 · i? · causal · r2

The report's year-1 versus year-2 analysis finds 8th-grade on-track NSI had positive first-year impacts on GPA, math and ELA course pass rates, and attendance that faded to non-significance by year 2; the report suggests pandemic disruption as a possible factor.

"These impacts were comparable in size to the impacts of the 9th-grade on-track NSI but they did not persist over time; the impacts after two years of participation were close to zero and not statistically significant for any outcome (as noted earlier)."

Discussion¶

Related Claims¶

• After schools' second year of participation, the 8th-grade on-track NSI did not impact the targeted student outcomes — possibly the same claim (merge candidate)
• The impact of the 9th-grade on-track NSI appeared to increase over time — related
• After schools' second year, the 9th-grade on-track NSI positively impacted GPA, core course pass rate, and credit completion — related
• Students' attendance and middle grades on-track rates in Success schools improved during the first two program years, especially in Year 2 — related
• Success schools' student GPAs did not show much improvement in the first two years — related
• 8th-grade on-track NSI positively impacted math test scores, moving students from the 37th to the 40th percentile — related
• 8th-grade on-track NSI did not improve ELA test scores, attendance, or suspension rates — possibly the same claim (merge candidate)
• College-ready on-track NSI did not impact GPA, advanced course taking, math and ELA test scores, graduation, or college enrollment — related