TLTS showed no detectable effect on science achievement after two years¶

Claim · All claims
Evidence · 1 study · causal r? · q4
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q4 i? After two years, TLTS had no detectable effect on student achievement in science (0.03 standard deviations, p = 0.266). → Naihobe Gonzalez 2023

Evidence¶

Naihobe Gonzalez 2023¶

Naihobe Gonzalez, Marykate Zukiewicz, Alicia Demers, Francisco Yang, Daniel Welsh. (2023). Evaluation of TNTP's Turnaround Leadership Teams Strategy, 2018–2022. Mathematica. https://www.mathematica.org/publications/evaluation-of-tntps-turnaround-leadership-teams-strategy-2018-2022

q4 · i? · causal · r?

In the same RCT, the science outcome was not a focus of TLTS supports. The report states "no detectable effect on student achievement in science (0.03 standard deviations, p-value = 0.266)"; equivalence was not tested.

"After two years, TLTS had no detectable effect on student achievement in science (0.03 standard deviations, p-value = 0.266)"

Discussion¶

Related Claims¶

• Grade 8 students in TLTS schools scored 0.12 standard deviations lower in social studies than comparison students — related
• After two years, TLTS raised student math achievement by 0.09 standard deviations relative to comparison schools — related
• After two years, TLTS raised student ELA achievement by 0.05 standard deviations relative to comparison schools — related
• The RD evaluation was powered to detect overall SES impacts of 0.12 standard deviations or larger — related
• Education evaluators increasingly design studies to detect impacts smaller than 0.20 standard deviations — related
• There is little evidence that math and reading specialists, one Turnaround Strategy component in targeted schools, had an impact on academic outcomes — related
• After two years, the Turnaround Strategy is producing improvements in math performance in targeted schools, with no evidence of positive impacts on other student outcomes — related
• TNTP achieved fidelity for TLTS's two key program components across Cohorts 2 and 3 — related