EWIMS did not have a detectable impact on school data culture, though the overall scale effect size (Hedges' g = 0.27) favored EWIMS¶

Claim · All claims
Evidence · 1 study · causal r2 · q2 · i1 small
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i1 Differences between EWIMS and control schools on the overall school data culture scale and its subscales were not statistically significant, but the overall effect size was Hedges' g = 0.27. → Faria 2017

Evidence¶

Faria 2017¶

Faria, A.-M., Sorensen, N., Heppen, J., Bowdon, J., Taylor, S., Eisner, R., & Foster, S. (2017). Getting students on track for graduation: Impacts of the Early Warning Intervention and Monitoring System after one year (REL 2017–272). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Midwest. http://ies.ed.gov/ncee/edlabs

q2 · i1 · causal · r2

Exploratory school-level analysis using the 2015 end-of-year school leader survey (66 schools). The printed effect size was Hedges' g = 0.27 for overall data culture; the quote states the effect size "(Hedges' g) for the overall school data culture scale was 0.27". Subscale differences were not statistically significant at p < .05.

"However, the effect size (Hedges' g) for the overall school data culture scale was 0.27, suggesting that although not statistically significant, EWIMS schools reported modestly higher data culture than control schools"

Discussion¶

Related Claims¶

• EWIMS schools were more likely than control schools to report using an early warning system and having a dedicated team, but did not differ in frequency of data review or interventions offered — related
• Overall implementation of the EWIMS seven-step process was low and challenging in the first year, with all but two schools categorized as low implementers — related