Item-level analysis found significant post-intervention improvement on five ScienceQuest items corresponding to the Changing Motion and Classifying Matter playlists¶

Claim · All claims
Evidence · 1 study · causal r1 · q2
Currency · newest study 2019 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Students receiving the intervention improved beyond comparison peers on five ScienceQuest items tied to the Changing Motion and Classifying Matter playlists, with one item significant at p = 0.006. → Li 2019

Evidence¶

Li 2019¶

Li, L., Maher, B., Weiser, G., Orenstein, A., Chow, E., & Atienza, S. (2019). Hero Elementary playlist pilot study in after-school programs. San Francisco, CA: WestEd. https://eric.ed.gov/?id=ED608115

q2 · i? · causal · r1

Exploratory differential item analysis of ScienceQuest post-test improvement by treatment condition using Pearson's chi-squared statistics; four items reached the .1 level and one item (H00X23) reached p = 0.006. The article labels these results as promising rather than confirmatory.

"Five items, corresponding to the playlists "Changing Motion" and "Classifying Matter", saw intervention-receiving students improve beyond their comparative peers."

Discussion¶

Related Claims¶

• The playlist intervention showed no significant difference in post-implementation science attitudes on the Emerging STEM Learning Activation Survey — related
• The Hero Elementary playlist intervention showed no statistically significant effect on K-2 students' science knowledge (effect size 0.10, p ~ 0.38) — related
• In a cluster-randomized trial of the virtual Hero Elementary program, treatment students scored higher than control students on a science post-assessment, but the difference was not statistically significant (effect size 0.15) — related