School-mean pretest scores predict posttest reading achievement in the OCR trial¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2016 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? In the three-level multilevel model, the school mean pretest is predictive of posttest achievement, with a one standard deviation increase in school pretest associated with a 0.89 increase in outcome scores. → Vaden-Kiernan 2016

Evidence¶

Vaden-Kiernan 2016¶

Vaden-Kiernan, M., Borman, G., Caverly, S., Bell, N., Ruiz de Castilla, V., Sullivan, K., & Fleming, G. (2016). Findings from a Multi-Year Scale-Up Effectiveness Trial of Open-Court Reading (Imagine It!). SREE Spring 2016 Conference. https://eric.ed.gov/?id=ED567512

q3 · i? · causal · r2

Multilevel (student, school, district) ITT model with grand-centered school-mean GRADE pretest scores; Table 2 prints a Pretest Mean coefficient of 0.51 (SE 0.05, ***) in Year 1 and 0.62 (SE 0.08, ***) in Year 2. This is an unstandardized coefficient, not a standardized effect size.

"The multilevel model results indicate that the schools mean pretest is predictive of the posttest achievement (see Table 2). A one standard deviation increase in school pretest score is associated with a 0.89 increase in outcome scores."

Discussion¶

Learner Variables¶

• Prior Knowledge — predictor: learners who differ on it differ in outcomes

Related Claims¶

• School-level assignment to the Open Court Reading (Imagine It!) curriculum does not produce a statistically significant impact on elementary students' reading achievement relative to business-as-usual control curricula in either study year — related
• The prognostic power of domain-identical pretests degrades with longer pre-posttest time lags, most strongly at the student level — related