Passport to Literacy produced a small positive but nonsignificant effect on GMRT reading comprehension (g = 0.28) relative to business-as-usual comparison¶

Claim · All claims
Evidence · 1 study · causal r3 · q3 · i1 small
Currency · newest study 2016 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i1 In a partially nested RCT, the treatment group outperformed comparison on GMRT reading comprehension with g = 0.28, but the effect was nonsignificant after Benjamini-Hochberg correction. → Wanzek et al. 2016

Evidence¶

Wanzek et al. 2016¶

Jeanne Wanzek, Yaacov Petscher, Stephanie Al Otaiba, Shawn C. Kent, Christopher Schatschneider, Martha Haynes, Brenna K. Rivas, Francesca G. Jones. (2016). Examining the Average and Local Effects of a Standardized Treatment for Fourth Graders with Reading Difficulties. https://eric.ed.gov/?id=ED577133

q3 · i1 · causal · r3

Partially nested randomized controlled trial with 221 fourth graders assigned within school to treatment (n = 111) or comparison (n = 110); mixed models controlled pretest and accounted for clustering. The GMRT result was "a significant, positive effect (g = 0.28)" that became nonsignificant after correction for seven tests.

"The individual mixed model for the GMRT reading comprehension outcome resulted in a significant, positive effect (g = 0.28); however, the application of the Benjamini-Hochberg correction for the seven tests of treatment effects yielded a non-significant p-value."

Discussion¶

Related Claims¶

• Quantile regression revealed larger intervention effects on GMRT reading comprehension at the .25–.30 quantiles (g = .35, ~9 points) and the .50 quantile (g = 0.22, ~5 points), but not at other quantiles or on WJ-III Passage Comprehension — related
• A standard Tier 2 multi-component reading intervention produced no statistically significant differences versus business-as-usual on any of seven reading outcomes for fourth graders at or below the 15th percentile in comprehension — related
• Quantile regression showed significant Passport to Literacy effects only between the .40 and .70 quantiles of GMRT posttest comprehension — related
• The multi-component intervention produced statistically significant advantages over business-as-usual on one decoding measure (ES = 0.58) and one fluency measure (ES = 0.46), but not on reading comprehension — related
• Passport to Literacy showed no significant effects on word reading, decoding, or oral reading fluency outcomes — related