The Hero Elementary playlist intervention showed no statistically significant effect on K-2 students' science knowledge (effect size 0.10, p ~ 0.38)¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r1 · q2
Currency · newest study 2019 · checked against its sources 2026-10-20 (automated, 2 of 2 entries) · not reviewed by a person

Subclaims¶

q2 i? Students who received the playlist intervention did not significantly exceed comparison peers on ScienceQuest post-test scores (adjusted difference 0.41, effect size 0.102, CI [-0.51, 1.33]). → Li 2019

Evidence¶

Li 2019¶

Li, L., Maher, B., Weiser, G., Orenstein, A., Chow, E., & Atienza, S. (2019). Hero Elementary playlist pilot study in after-school programs. San Francisco, CA: WestEd. https://eric.ed.gov/?id=ED608115

q2 · i? · causal · r1

Quasi-experimental pilot with 161 K-2 students in four after-school programs; multivariate regression with pre-tests as covariates. The intervention exceeded comparison peers with a "point estimate of 0.41" and effect size 0.102, not significant at alpha 0.05 (p ~ 0.38).

"Adjusted mean differences on the post-test measure of ScienceQuest showed that students who received the intervention exceeded their comparison peers in total score (point estimate of 0.41) which corresponded to an effect size of 0.102 but which had a confidence interval of [-0.51, 1.33]."

Li 2019 (2)¶

Li, L., Maher, B., Weiser, G., Orenstein, A., Chow, E., & Atienza, S. (2019). Hero Elementary playlist pilot study in after-school programs. San Francisco, CA: WestEd. https://eric.ed.gov/?id=ED608115

q2 · i? · causal · r1

Baseline imbalance study note: the treatment group scored higher on ScienceQuest at pre-test (means 18.64 vs 16.62, SMD 0.48), which the regression model was used to adjust for.

"However, the treatment group had higher pre-test scores on ScienceQuest (Table 6)."

Discussion¶

Related Claims¶

• The playlist intervention showed no significant difference in post-implementation science attitudes on the Emerging STEM Learning Activation Survey — related
• Item-level analysis found significant post-intervention improvement on five ScienceQuest items corresponding to the Changing Motion and Classifying Matter playlists — related
• Baseline pre-assessment scores showed no statistical differences between treatment and control groups in either the matched or baseline sample. — related
• In a cluster-randomized trial of the virtual Hero Elementary program, treatment students scored higher than control students on a science post-assessment, but the difference was not statistically significant (effect size 0.15) — related
• The study enrolled 34 second-grade teachers with 810 students across 20 California schools, with 318 students completing both assessments in the impact sample. — related
• Teachers found Hero Elementary playlist hands-on activities easy to implement because materials were supplied and prepped. — related
• Educators rarely facilitated connections between playlist activities or to students' lives; introductions focused on instructions and logistics, and debriefings were often unstructured reviews of the activity — related
• TAIA produced higher adjusted post-test scientific achievement than worksheet-supported inquiry, controlling for pre-test and ICT competency — related
• Digital notebooks presented technical difficulties with projection and loading during in-school implementation. — related
• Science-classroom studies of cooperative learning show mixed results, with several null or negative comparisons — related
• Technical issues (login scanning, internet connectivity, projector setup, and glitches) frustrated students and created a significant barrier to playlist implementation — related
• No statistically significant difference in children's post-assessment ocean science scores between intervention and comparison groups — related