Playing Losing the Lake significantly increased seventh graders' objective-test content knowledge relative to a control group viewing an earth science website¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r2 · q4 · i3 large
Currency · newest study 2015 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q4 i? In a randomized two-group field trial, the experimental group's objective test scores increased significantly from pretest to posttest and delayed posttest while the control group remained flat, with a significant group-by-time interaction (Wald χ2 = 9.83, p = .002). → E. Michael Nussbaum 2015 q4 i3 The between-group difference at posttest was significant with d = 1.01 and at delayed posttest with d = 0.75, with no pretest difference. → E. Michael Nussbaum 2015 (2)

Evidence¶

E. Michael Nussbaum 2015¶

E. Michael Nussbaum, Marissa C. Owens, Gale M. Sinatra, Abeera P. Rehmat, Jacqueline R. Cordova, Sajjad Ahmad, Fred C. Harris, Jr., Sergiu M. Dascalu. (2015). Losing the Lake: Simulations to Promote Gains in Student Knowledge and Interest about Climate Change. https://doi.org/10.12973/ijese.2015.277a

q4 · i? · causal · r2

Randomized pretest/posttest/delayed-posttest two-group experiment with 119 seventh graders assigned to the game or a control website; generalized linear modeling with GEE showed a significant group-by-time interaction ("Wald χ 2 = 9.83, p = .002"). No effect size is printed for the omnibus interaction.

"As we had hypothesized, the objective test scores significantly increased in the experimental group from pretest to posttest/delayed posttest but there was no gain in the control group. The omnibus test was significant (Wald χ 2 = 9.83, p = .002)"

E. Michael Nussbaum 2015 (2)¶

E. Michael Nussbaum, Marissa C. Owens, Gale M. Sinatra, Abeera P. Rehmat, Jacqueline R. Cordova, Sajjad Ahmad, Fred C. Harris, Jr., Sergiu M. Dascalu. (2015). Losing the Lake: Simulations to Promote Gains in Student Knowledge and Interest about Climate Change. https://doi.org/10.12973/ijese.2015.277a

q4 · i3 · causal · r2

Planned comparisons on the objective test found no pretest group difference but significant posttest ("d = 1.01") and delayed-posttest ("d = 0.75") differences favoring the experimental group.

"There was no significant difference between the groups at pretest (p = .95), but there was at posttest (p < .001, d = 1.01) and delayed posttest (p =.002, d = 0.75)."

Discussion¶

Related Claims¶

• Playing the game produced a small but significant increase in student interest, driven by items about Las Vegas water sources and home water conservation — related
• The game produced large gains on the constructed-response household conservation item but no significant effect on the Las Vegas water-conservation importance item — a narrower finding that bears on this claim
• Knowledge gains from the game were largest on water-flow, weather-vs-climate, greenhouse-effect, and household-conservation items, but three misconceptions were not effectively addressed — related
• Students rated the game positively, most often citing fun/interactive features, visuals, and new information learned — related