Traditional challenge-navigation measures (level choice, replays, careful retries, hint reading, coding time) did not relate to learning outcomes¶
Claim · All claims
Evidence · 1 study · associationalr2·q2
Currency · newest study 2016 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Only challenge-approach measures involving complex code correlated with posttest; measures such as Hards Replayed, Immediate Replays, Careful Hard Retries, Careful Hint Reads, and Coding Time Day 2 did not. → Malkiewich 2016
Evidence¶
Malkiewich 2016¶
Malkiewich, L. J., Lee, A., Slater, S., & Chase, C. C. (2016). Tenacious Assessments: Using In-Game Behaviors to Measure Student Persistence and Challenge Navigation. https://eric.ed.gov/?q=Tenacious+Assessments+Using+In-Game+Behaviors
q2 · i? · associational · r2
Authors' summary of the correlation analyses (Table 2): the correlation matrix shows non-significant posttest associations for Immediate Replays, Hards Replayed, Careful Hard Retries, Careful Hint Reads, and Coding Time Day 2, while only complex-code measures reached significance.
"It is important to note that in this study, more traditional measures of challenge navigation (e.g. choosing to play a hard vs. an easy level) and general persistence did not relate to learning outcomes."
Discussion¶
Related Claims¶
- Downgrading to simpler code after failure on personally hard levels is negatively associated with persistence on an unsolvable task
- Relative-Hards Solved Complex, a log measure of using complex code on personally difficult levels, predicts time spent on an unsolvable challenge task
- In-game willingness to solve hard levels with complex code is positively associated with posttest coding knowledge, controlling for pretest — reports the opposite
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
traditional-challenge-measures-not-related-to-learning |
title |
Traditional challenge-navigation measures (level choice, replays, careful retries, hint reading, coding time) did not relate to learning outcomes |
description |
Traditional challenge-navigation measures (level choice, replays, careful retries, hint reading, coding time) did not relate to learning outcomes |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2016 |
generated |
by process:wiki-ingest on 2026-10-16 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — malkiewich-2016 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.