Aggregate play-efficiency measures in Progenitor X were not correlated with pre-post learning gains, except for efficiency in the final organ boss level (r = .3219)¶

Claim · All claims
Evidence · 1 study · design r2 · q2 · i2 medium
Currency · newest study 2012 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i2 Aggregate efficiency ratio, total tries, and total successes were not significantly correlated with pre-post learning gains, but boss-level efficiency ratio was positively correlated (r = .3219). → Richard Halverson 2012

Evidence¶

Richard Halverson 2012¶

Richard Halverson, Elizabeth Owen, Nathan Wills, R. Benjamin Shapiro. (2012). Game-Based Assessment: An integrated model for capturing evidence of learning in play. ERIA Working Paper. http://www.eriainteractive.com/index.php

q2 · i2 · design · r2

Aggregate analysis of play data from 39 students comparing game-progress measures with pre-post gains. The article reports no significant correlation for total tries, successes, or aggregate efficiency ratio, but a positive boss-level correlation (r = .3219, α = .10).

"Neither the total numbers of tries, the total numbers of successes, nor the aggregate efficiency ratio (across cycles) were significantly correlated with pre-post learning gains. Only in the last cycle of the game (the organ cycle boss level) was the efficiency ratio correlated with pre-post gains (r = .3219)."

Discussion¶

Related Claims¶

• The number of far failures — cycles ended by incorrect collection and/or time running out — was negatively correlated with pre-post learning gains in Progenitor X
• After playing Progenitor X over three weeks, 39 middle and high school students showed a statistically significant 11% pre-post gain in stem-cell science content knowledge, in a one-group design with no comparison
• Number of cell-cycle starts and cell-cycle destroys in Progenitor X were negatively correlated with pre-post learning gains, while total cycle starts across the game were not — related
• Upper-quartile and lower-quartile learning-gain players showed opposite correlations between cell-cycle activity and learning, and lower-quartile players had more far failures (7 vs 2.3 average cycles) — related