A lottery-based randomized controlled trial at Lied replicated the positive, statistically significant impact on 6th graders' mathematics achievement found by the QED¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? The RCT based on Lied's oversubscription lottery, a more rigorous design than the QEDs, replicated the QED's positive and statistically significant impact on 6th graders' mathematics achievement. → Nakamoto 2022

Evidence¶

Nakamoto 2022¶

Nakamoto, J., Grant, A., Snipes, J., Allender, S., & Figueroa, T. (2022). Clark County School District Magnet Schools Assistance Program (MSAP): Spring 2022 interim evaluation summary report. WestEd. https://eric.ed.gov/?id=ED621271

q3 · i? · causal · r2

Randomized controlled trial exploiting Lied's oversubscription lottery: 1,023 first-choice applicants randomized, with 382 lottery winners and 404 non-winners as complete cases in the intent-to-treat analysis. The report states the RCT "replicated the positive and statistically significant impact" on mathematics; no effect size is printed in the available text.

"The findings from the RCT, which is a more rigorous design than the QEDs, replicated the positive and statistically significant impact on the 6th graders' mathematics achievement found by the QED."

Discussion¶

Related Claims¶

• The study uses a randomized controlled trial design in which admissions lottery offers make the treatment group similar on average to the control group on observable and unobservable characteristics. — related
• A lottery-based randomized experimental analysis confirms KIPP middle schools' positive impacts — a broader claim this one bears on
• The intervention significantly benefited 6th-grade students but showed no significant effects for 7th or 8th graders — related
• Lied magnet students in grades 6-8 attempted and completed significantly more STEM credits than matched comparison students — related
• A lottery-based randomized controlled trial of KIPP middle schools found statistically significant positive effects on state math and reading tests — related
• The evaluation has not yet rigorously examined whether the magnet schools reduce, eliminate, or prevent minority group isolation; this is deferred to the final report
• Attendance at Gehring STEM Academy had statistically significant positive impacts on mathematics and reading achievement in grades 1-5 after up to 1.5 years, with no significant science impacts — related