Students using Wayang Outpost earned higher state standardized test (MCAS) scores at year end than matched control students¶

Claim · All claims
Evidence · 1 study · causal r2 · q2
Currency · newest study 2014 · not yet checked against its sources · not reviewed by a person
Design limits · Arroyo 2014: groups were assigned but students were analysed as independent (read from the study by two models, 2026-10-27)

Subclaims¶

q2 i? Across studies since 2004, students who used Wayang Outpost had higher end-of-year MCAS standardized test scores than control students in the same school, grade and with the same teachers. → Arroyo 2014

Evidence¶

Arroyo 2014¶

Arroyo, I., Woolf, B. P., Burelson, W., Muldner, K., Rai, D., & Tai, M. (2014). A Multimedia Adaptive Tutoring System for Mathematics that Addresses Cognition, Metacognition and Affect. Int J Artif Intell Educ 24:387–426. https://doi.org/10.1007/s40593-014-0023-y

q2 · i? · causal · r2

Aggregate analysis of Massachusetts MCAS results from studies since 2004 with matched control groups within the same school, grade and teachers; the figure prints passing-rate percentages and p-values (e.g., p<0.01, N=154) favoring Wayang groups. The article reports "higher standardized tests scores at the end of the year" for Wayang users.

"Fig. 4 shows aggregate results since 2004, and highlights that students had higher standardized tests scores at the end of the year after using Wayang Outpost as compared to students in a control condition who did not use the software."

Discussion¶

Related Claims¶

• Math fact retrieval (MFR) fluency training before Wayang tutoring improved math learning (Wayang vs. no-Wayang d = 0.39), with the Wayang-MFR combination scoring highest — related
• In the 2012 study, classes using Wayang showed significantly larger MAP gains in patterns and algebra than control classes (d = 0.38) — related