After two years, RSF Cohort 1 students generally performed at the same levels as propensity-score-matched comparison students, with few statistically significant differences¶

Claim · All claims
Evidence · 1 study · causal r2 · q2
Currency · newest study 2008 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Comparing RSF Cohort 1 students with matched comparison students from sending schools after 2 years yielded few statistically significant differences: School 4 scored 11 points higher in reading, while Schools 2 and 6 scored significantly below their controls in both reading and mathematics. → Young 2008

Evidence¶

Young 2008¶

Young, V. M., Humphrey, D. C., Wang, H., Bosetti, K. R., Cassidy, L., Wechsler, M. E., Rivera, E., Murray, S., & Schanzenbach, D. W. (2008). Renaissance Schools Fund-Supported Schools: Early Outcomes, Challenges, and Opportunities. SRI International. https://consortium.uchicago.edu/publications/renaissance-schools-fund-supported-schools-early-outcomes-challenges-and-opportunities

q2 · i? · causal · r2

Propensity score matching on ethnicity, lunch status, ELL status, and prior performance created comparison groups from sending schools; ISAT scale scores and standards-passing rates were compared after 2 years. School 4 also had "23 percentage points more students (59% versus 36%)" meeting reading standards; School 6 had lower passing rates in both subjects.

"At the end of the second year of operation, School 4 students scored a statistically significant 11 points higher than their matched control group in reading. In contrast, School 2 and School 6 students’ performance was statistically significant and below their respective control groups in both reading and mathematics."

Discussion¶

Related Claims¶

• After one year, RSF Cohort 2 students generally performed at the same levels as matched comparison students, with only three statistically significant differences — related
• Students entering RSF-supported schools had prior reading and mathematics achievement similar to peers who remained at their sending schools, with a few exceptions — related
• Most RSF-supported Cohort 1 schools increased the percentage of students meeting or exceeding ISAT standards from year 1 to year 2 — related
• ISAT scores are not comparable over time: students with identical earlier and later test scores earned different seventh-grade ISAT scores depending on the year tested — related
• Propensity score weighting balanced the two non-intervention control groups on all outcomes at T2 and T3, supporting internal validity — related