Current measurement models underlying achievement testing assume students respond effortfully to test items¶

Claim · All claims
Evidence · 1 study · theoretical r? · q2
Currency · newest study 2015 · checked against its sources 2026-10-17 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2018: tool and model accuracy changes quickly

Subclaims¶

q2 i? Standard measurement models for achievement testing rest on the assumption that students respond effortfully, so non-effortful responding violates the models' basis for score interpretation. → Steven Wise 2015

Evidence¶

Steven Wise 2015¶

Steven Wise. (2015). Effort analysis: Individual score validation of achievement test data. Applied Measurement in Education, 28(3), 237–252. https://www.nwea.org/research/publication/effort-analysis-individual-score-validation-of-achievement-test-data/ doi:10.1080/08957347.2015.1042155

q2 · i? · theoretical · r?

The abstract states the assumption directly: "current measurement models underlying achievement testing assume students respond effortfully to test items," which motivates identifying materially distorted scores. This is a conceptual argument, not a tested result.

"Because current measurement models underlying achievement testing assume students respond effortfully to test items, it is important to identify test scores that have been materially distorted by non-effortful test taking."

Discussion¶

Related Claims¶

• E-M scoring assumes the remaining responses are unaffected by disengagement, and this assumption can fail under partial engagement — a narrower finding that bears on this claim
• E-M scoring leaves residual score distortion, suggesting some disengaged test responses are nonrapid rather than rapid guesses — a narrower finding that bears on this claim
• Responses used in effort-moderated scoring can sometimes reflect less-than-full, or partial, engagement, making E-M scores less trustworthy — a narrower finding that bears on this claim
• Effort-moderated scoring estimates disengaged test takers' performance by excluding disengaged responses and scoring the remaining responses — related
• The effort-moderated IRT model's parameter estimation accuracy was studied under multiple assumption violations in the context of test-taking disengagement — related
• Rapid guessing can be identified from item-level response time, and its proper interpretation depends on contextual requirements — related
• Rapid guessing is a validated indicator of disengaged item responding — related
• Manipulation trials were excluded from performance scoring to preserve WAIS-III validity — related