Hill and Lenard (2016): LevelSet Lexile effects were negative in spring 2014 and positive in spring 2015¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q2
Currency · newest study 2018 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In a cluster randomized trial in grades 2–5, the LevelSet Lexile effect was statistically significant and negative in spring 2014 and statistically significant and positive in spring 2015; the two-year average was indeterminate. → What Works Clearinghouse 2018

Evidence¶

What Works Clearinghouse 2018¶

What Works Clearinghouse, Institute of Education Sciences, U.S. Department of Education. (2018). Adolescent Literacy intervention report: Achieve3000®. https://whatworks.ed.gov

q2 · i? · quant-synthesis · r2

Two-year cluster RCT in Wake County, NC (22,583 students in the general literacy analysis); spring 2014 effect size was −0.04 (p < .05) and spring 2015 was 0.21 (p < .01), with the direction reversing between years.

"The authors also reported, and the WWC confirmed, a statistically significant negative effect of Achieve3000® for students in grades 2–5 on the LevelSet Lexile score in spring 2014."

Discussion¶

Related Claims¶

• General literacy achievement domain: one statistically significant positive effect and one indeterminate effect yield a potentially positive rating — related
• Comprehension domain: one study found a substantively important positive effect and one an indeterminate effect — related
• EL students using Achieve3000 scored significantly higher on adjusted post-pilot Lexile scores than comparison students who did not use the tool — related
• Achieve3000 usage predicted about 3.5 percent of current Lexile scores after controlling for pre-test Lexile, motivation, and age — related
• Newcomer EL students using BrainPOP ESL showed no statistically significant Lexile growth, and results lacked a comparison group — related