Educational apps produce effects about 0.17 SD higher on constrained than unconstrained skills¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q3 · i1 small
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i1 Controlling for grade and assessment type, apps showed larger effects on constrained skills (predicted g = 0.31) than unconstrained skills (g = 0.14). → James Kim 2021

Evidence¶

James Kim 2021¶

James Kim, Joshua Gilbert, Qun Yu, Charles Gale. (2021). Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children's Literacy and Math Skills. AERA Open. https://doi.org/10.1177/23328584211004183

q3 · i1 · quant-synthesis · r2

Final RVE meta-regression model (Model 5, Table 6) after removing nonsignificant moderators; constrained outcome coefficient 0.173, p < .01. Figure 2 predicted means: constrained g = 0.31 vs. unconstrained g = 0.14.

"educational apps produced mean effects that were approximately 0.17 SDs higher on constrained skills than on unconstrained skills (within or between studies), controlling for participant grade and the type of outcome assessment"

Discussion¶

Related Claims¶

• App quality ratings are not significantly associated with mean effect sizes controlling for assessment type — related
• App effects are larger in studies of preschool children than kindergarten to Grade 3 children — related
• Studies using researcher-developed outcomes yield effects about 0.42 SD larger than studies using standardized outcomes — related
• Educational apps produce a positive mean effect of about +0.31 standard deviations on preschool to Grade 3 children's literacy and math achievement — related
• App effects on literacy (g = 0.35) and math (g = 0.29) are comparable — related