Most studies of literacy resilience have (very) small sample sizes and low statistical power to find relevant effects¶

Claim · All claims
Evidence · 1 study · review r2 · q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Most of the 22 included studies had (very) small sample sizes, yielding low statistical power to detect relevant effects. → Appels 2024

Evidence¶

Appels 2024¶

Appels, S., van Viersen, S., van Erp, S., Hornstra, L., & de Bree, E. (2024). A scoping review on word-reading resilience in literacy: Evaluating empirical evidence for protective factors. Learning and Instruction, 93, 101969. https://doi.org/10.1016/j.learninstruc.2024.101969

q2 · i? · review · r2

Systematic scoping review analysis of 22 included empirical studies of compensation in literacy development. The review reports that "most studies had (very) small sample sizes and thus low statistical power to find relevant effects"; no effect size is printed for this methodological finding.

"Analysis of the 22 included studies revealed two main findings: 1) most studies had (very) small sample sizes and thus low statistical power to find relevant effects"

Discussion¶

Related Claims¶

• Study designs and statistical analyses in literacy resilience research are often insufficient to distinguish promotive, protective, and skill-enhancing factors — related
• Unreliability in an outcome measure reduces the statistical power of treatment-control comparisons — related
• Clustering effects in education random-assignment trials vary by design but are typically large, requiring large school samples — related
• Robust RDD methods protect against model misspecification but require much larger sample sizes to detect small effects — related
• Evidence for promotive and skill-enhancing factors in literacy resilience is underrecognized while the same evidence is overinterpreted towards protective effects — related
• Empirical evidence for protective factors in word-reading resilience is sparse and based on only a few studies — related