Pseudo-interactive videos also outperformed non-interactive videos by 0.16 standard deviations on science learning¶

Claim · All claims
Evidence · 1 study · causal r3 · q3 · i1 small
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i1 Children in the pseudo-interactive condition performed better than those in the non-interactive condition by 0.16 standard deviations (p = .04), indicating that even question-asking without contingency aids learning. → Ying Xu 2023

Evidence¶

Ying Xu 2023¶

Ying Xu, Kunlei He, Julian Levine, Daniel Ritchie, Zexuan Pan, Andres Bustamante, and Mark Warschauer. (2023). Artificial Intelligence Enhances Children's Science Learning from Television Shows. https://osf.io/j7upd

q3 · i1 · causal · r3

Reference-group change in the same RCT regression. Printed standardized effect size: 0.16 standard deviations — "children in the pseudo-interactive condition also performed better than those in the non-interactive condition by 0.16 standard deviations (p = .04)". Descriptive accuracy 59.71% pseudo vs 55.69% non-interactive.

"when changing the regression reference group, we found that children in the pseudo-interactive condition also performed better than those in the non-interactive condition by 0.16 standard deviations (p = .04)"

Discussion¶

Related Claims¶

• Children who watched AI-powered interactive videos with contingent feedback scored 0.32 standard deviations higher on a science post-test than children who watched the non-interactive broadcast version — related
• Contingent AI feedback outperformed pseudo-interactive generic feedback: interactive viewers scored 0.16 standard deviations higher than pseudo-interactive viewers on science learning — related
• Contingent AI interaction increased children's likelihood of responding over time (OR = 1.026 per question), while pseudo-interactive interaction decreased it (OR = 0.96) — related
• Pseudo-interactive responses showed significantly more repetition: a lower type-token ratio than interactive responses (t = 3.371, p = .001) — related
• Verbal engagement correlated more strongly with science learning in the interactive condition (response rate r = .485) than in the pseudo-interactive condition (r = .193) — related
• Children in the interactive condition responded to 77.94% of Elinor's questions versus 68.13% in the pseudo-interactive condition — related