A lottery-based randomized experimental analysis confirms KIPP middle schools' positive impacts¶

Claim · All claims
Evidence · 1 study · causal r? · q4
Currency · newest study 2013 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q4 i? One of the report's analyses confirms the positive impacts using a rigorous randomized experimental analysis based on the schools' admissions lotteries. → Christina Clark Tuttle 2013

Evidence¶

Christina Clark Tuttle 2013¶

Christina Clark Tuttle, Brian Gill, Philip Gleason, Virginia Knechtel, Ira Nichols-Barrer, Alexandra Resch. (2013). KIPP Middle Schools: Impacts on Achievement and Other Outcomes. Washington, DC: Mathematica Policy Research. https://www.mathematica.org/publications/kipp-middle-schools-impacts-on-achievement-and-other-outcomes-full-report

q4 · i? · causal · r?

Randomized experimental analysis relying on KIPP admissions lotteries to identify comparison students; the lottery design "account[s] for students’ prior achievement, as well as factors such as student and parent motivation." No effect size is printed on this page.

"One of the report’s analyses confirms the positive impacts using a rigorous randomized experimental analysis that relies on the schools’ admissions lotteries to identify comparison students, thereby accounting for students’ prior achievement, as well as factors such as student and parent motivation."

Discussion¶

Related Claims¶

• A lottery-based randomized controlled trial of KIPP middle schools found statistically significant positive effects on state math and reading tests — possibly the same claim (merge candidate)
• In the vast majority of 22 KIPP middle schools, impacts on students' state assessment scores in math and reading are positive, statistically significant, and educationally substantial — related
• Average KIPP middle school impacts were positive and statistically significant throughout the 10-year study period, though higher in earlier years than recent years — related
• KIPP middle schools have positive, statistically significant, and educationally meaningful impacts on student achievement in math, reading, science, and social studies — related
• The Fisher Fellowship selection instrument is reliable, though three of 34 items had relatively low levels of one type of reliability — related
• An earlier report of the national KIPP evaluation described strong positive achievement impacts in math and reading for 22 KIPP middle schools — related
• Prior research on KIPP suggested positive achievement impacts but was limited by small samples or methodological weaknesses — a broader claim this one bears on
• KIPP middle school offers did not produce higher five-year four-year graduation or on-track rates than no offer — related
• The KIPP lottery-based randomized controlled trial yielded treatment and control groups similar on observable and unobservable characteristics — related
• A lottery-based randomized controlled trial at Lied replicated the positive, statistically significant impact on 6th graders' mathematics achievement found by the QED — a narrower finding that bears on this claim
• Successor Prep school outcomes appeared similar to other KIPP schools, though substantial differences cannot be ruled out — related
• In the earlier National Evaluation of Charter Middle Schools, admission to about 30 charter middle schools produced no significant average effects on achievement, though some schools improved achievement — related
• A long-term tracking study follows 1,177 students who applied to 13 oversubscribed KIPP middle schools through 5th or 6th grade admissions lotteries in 2008 or 2009 to examine college enrollment and early college persistence. — related
• Receiving an offer of admission to a KIPP middle school increases enrollment in 4-year college programs by 6.9 percentage points — related
• Admission to a charter middle school does not affect college enrollment, per a lottery-based study of 31 charter middle schools — related
• The national KIPP evaluation uses experimental and quasi-experimental methods to estimate effects of KIPP middle schools across the country — a broader claim this one bears on