The WATS efficacy estimate is qualified by high instructor attrition, and replication with a second cohort is underway¶

Claim · All claims
Evidence · 1 study · causal r2 · q2
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The study suffered from high instructor attrition, which the authors state may bias the outcome of results. → Shandy Hauk 2017

Evidence¶

Shandy Hauk 2017¶

Shandy Hauk, Bryan Matlen, Larry Thomas. (2017). Exploration of the Factors that Support Learning: Web-based Activity and Testing Systems in Community College Algebra. 20th Annual Conference on Research in Undergraduate Mathematics Education. https://sigmaa.maa.org/rume

q2 · i? · causal · r2

Authors' stated limitation of the first-cohort cluster randomized trial: "high instructor attrition, which may bias the outcome of results". A second cohort repeats the design in 2016-17, and pooled results will test replication across populations.

"We note this study suffered from high instructor attrition, which may bias the outcome of results. To investigate the robustness of the findings above, we are in the process of repeating this study with a second cohort of participants"

Discussion¶

Related Claims¶

• Using a WATS in community college elementary algebra corresponds to a statistically significant 2.59-point post-test gain (Hedges g = 0.32) controlling for pretest — related
• The study's invariance findings may be biased by excluding students who missed a test and by sample heterogeneity — related
• Adaptive web-based system treatment showed a small, statistically non-significant advantage over control on elementary algebra post-test scores (Hedges' g = .12) — related