Stealth assessment¶
Research Method · All research methods
Evidence · 3 claims (3 for) · 2 studies (1 causal, 1 associational),q2–q3· 0 of 2 report an effect size · 3 claims rest on one study
Description¶
Stealth assessment is an approach in which measurement of a skill is woven into gameplay so that students' ordinary choices generate the assessment data without them knowing they are being assessed. The article describes it as assessments "woven directly and invisibly into the fabric" of the game, with "players' choices during gameplay provide the data needed for assessment." Zoo U applies this by logging dialogue choices, clicks, and time on and off task to compute social skills performance indices, reducing observer reactivity compared with naturalistic observation.
Accounts¶
- Stealth assessment: embedding skill measurement invisibly in game play so that player choices supply the assessment data: Stealth assessment is an approach in which measurement of a skill is woven into gameplay so that students' ordinary choices generate the assessment data without them knowing they are being assessed. The article describes it as assessments "woven directly and invisibly into the fabric" of the game, with "players' choices during gameplay provide the data needed for assessment." Zoo U applies this by logging dialogue choices, clicks, and time on and off task to compute social skills performance indices, reducing observer reactivity compared with naturalistic observation. (Melissa E. DeRosier et al. (2012))
- Stealth assessment of persistence via in-game time-on-task measures: Stealth assessment embeds evidence-centered-design models into digital games, collecting log-file performance data as learners play and using statistical methods such as Bayes nets to make real-time inferences about hard-to-measure competencies. In this study, persistence was operationalized as time spent on ultimately unsolved problems plus time above the per-problem average on solved problems, yielding 3,803 data points from 137 students. The authors state that "stealth assessment (Shute, 2011) uses technology-rich environments (e.g., digital games) as vehicles for assessment." Prior work validated such in-game measures against external performance-based measures. (Rahimi et al. (2021))
- Stealth assessment: formative assessment seamlessly woven into immersive learning environments: Stealth assessment is "an evidence-based approach to assessment where the tasks that students are engaged with are highly interactive and immersive, such as within video games." Performance data is "continuously gathered during the course of playing/learning" and inferences about competency states are stored in a dynamic learner model. The approach aims to support learning, maintain flow, reduce test anxiety without sacrificing validity and reliability, and "blur the distinction between assessment and learning." It relies on automated scoring and machine-based reasoning to infer competencies across a network of skills. (Shute et al. (2013))
- Stealth assessment: invisible assessment woven into gameplay: Stealth assessment involves designing, developing, and weaving assessments directly and invisibly into the fabric of complex learning environments, particularly video games. Evidence for targeted skills comes from players' interactions with the game itself (the processes of play), with inferences about competency states stored in a dynamic learner model in real time. This contrasts with singular outcome measures typical of educational environments. Real-time estimates can drive adaptivity (e.g., adjusting task difficulty) and timely individualized feedback while maintaining flow. (Shute et al. (2020))
Claims¶
- Physics understanding difficulty is a stronger predictor of in-game persistence than game mechanics difficulty in Physics Playground [+M]
- Gold and silver trophy counts are the only significant student-level predictors of persistence, with negative relationships [+M]
- In a controlled evaluation with 268 ninth-grade students, embedding elaborated feedback in the ACED system did not impair assessment quality and produced significantly greater learning than a control group [+M]
Related Research Methods¶
-
Key Sources¶
- Melissa E. DeRosier, Ashley B. Craig, and Rebecca P. Sanchez. (2012). Zoo U: A Stealth Approach to Social Skills Assessment in Schools. Advances in Human-Computer Interaction. https://doi.org/10.1155/2012/654791
- Rahimi, S., Shute, V., & Zhang, Q. (2021). The effects of game and student characteristics on persistence in educational games: A hierarchical linear modeling approach. International Journal of Technology in Education and Science (IJTES), 5(2), 141-165. https://doi.org/10.46328/ijtes.118
- Shute, V. J., & Kim, Y. J. (2013). Formative and stealth assessment. In J.M. Spector et al. (eds.), Handbook of Research on Educational Communications and Technology. Springer. https://doi.org/10.1007/978-1-4614-3185-5_25
- Shute, V. J., & Rahimi, S. (2020). Stealth Assessment of Creativity in a Physics Video Game. Computers in Human Behavior. https://www.sciencedirect.com/science/article/pii/S0747563220303940
Page metadata
| Field | Value |
|---|---|
type |
research-method |
id |
stealth-assessment |
title |
Stealth assessment |
description |
Stealth assessment is an approach in which measurement of a skill is woven into gameplay so that students' ordinary choices generate the assessment data without them knowing they are being assessed. |
status |
review |
generated |
by process:settle-candidates on 2026-10-16 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.