Rapid-guessing behavior on an adaptive achievement test is inconsistent with most proposed models of unmotivated test taking except the effort-moderated model¶

Claim · All claims
Evidence · 1 study · associational r? · q2
Currency · newest study 2016 · checked against its sources 2026-10-09 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2019: tool and model accuracy changes quickly

Subclaims¶

q2 i? Observed rapid-guessing behavior and item response accuracy did not match the behavior expected under several proposed unmotivated-test-taking models, with the exception of the effort-moderated model. → Modeling student test-taking motivation in the context of an adaptive achievement test 2016

Evidence¶

Modeling student test-taking motivation in the context of an adaptive achievement test 2016¶

Modeling student test-taking motivation in the context of an adaptive achievement test. (2016). Journal of Educational Measurement, 53(1), 86–105. https://www.nwea.org/research/publication/modeling-student-test-taking-motivation-in-the-context-of-an-adaptive-achievement-test/

q2 · i? · associational · r?

Response time-based analysis of data from an adaptive achievement test compared observed rapid-guessing patterns to model expectations; the study found behavior "inconsistent with these models, with the exception of the effort‐moderated model." No effect size is printed.

"patterns of observed rapid‐guessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent unmotivated test taking behavior. Test taker behavior was found to be inconsistent with these models, with the exception of the effort‐moderated model."

Discussion¶

Related Claims¶

• A proposed effort-guided adaptive test alleviates item difficulty mistargeting caused by unmotivated test taking, as shown by simulation — related
• Effort-moderated scoring yields more accurate scores than traditional scoring on an adaptive achievement test — related
• Rapid-guessing behavior on an adaptive achievement test is inconsistent with an absorbing state model of unmotivated test taking — a narrower finding that bears on this claim
• Solution behavior accuracy does not decrease across item positions, contradicting decreasing effort models of unmotivated test taking — a narrower finding that bears on this claim
• An effort-guided CAT that holds the provisional achievement estimate constant after rapid guesses reduces standard errors and ameliorates severe item mis-targeting — related
• Rapid guessing is unrelated to item difficulty, inconsistent with the difficulty-based model of test-taking motivation — a narrower finding that bears on this claim
• The test platform detects rapid guessing in real time and attempts to re-engage disengaged students to protect score validity — related
• E-M scoring leaves residual score distortion, suggesting some disengaged test responses are nonrapid rather than rapid guesses — related
• Effort-moderated scoring yields more accurate achievement scores and better person fit than traditional MLE scoring when rapid guessing is present — related
• Traditional assessments are commonly perceived to suffer from student motivation deficits that gameful assessments propose to address — related
• E-M scoring assumes the remaining responses are unaffected by disengagement, and this assumption can fail under partial engagement — related
• Effort-moderated scoring exhibits improved person fit statistics compared with traditional scoring — related