Report stealth assessment results to educators via a color-coded dashboard at overall and facet level¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The authors teamed with GlassLab to design a dashboard report that lets educators interpret stealth assessment results overall and per facet. Each competency node is displayed in one of four states: "green/mastered (estimated as high)", "yellow/approaching mastery (estimated as medium)", "red/not mastered (estimated as low)", and grey when more gameplay data is needed. Grey is assigned when any pair of probabilities is less than 0.15 apart; otherwise EAP values determine the color. This supports targeted instructional support, such as suggesting reflective practices for a student low on evaluating progress.

Design Implications¶

Context¶

Requirements¶

• Sufficient gameplay data so that node probabilities are not too close (grey otherwise), and educator access to the GlassLab Games dashboard

Constraints¶

• The color thresholds (EAP in [0.34, 1] green, [-0.34, 0.33] yellow, [-1, -0.33] red) were designed for the Use Your Brainz problem solving assessment with middle school students

Target Learners¶

• middle school students

Target Learning Goals¶

• problem solving skill, overall and per facet, for educator interpretation and support

Affordances¶

• Four Facet Problem Solving Competency Model

Related Strategies¶

Examples¶

-

Key Sources¶

• Shute, V. J., Wang, L., Greiff, S., Zhao, W., & Moore, G. (2016). Measuring problem solving skills via stealth assessment in an engaging video game. Computers in Human Behavior, 63, 106-117. https://doi.org/10.1016/j.chb.2016.05.047