Rapid guessing as an opt-out decision within the measurement process¶

Theory · All theories
Evidence · 3 claims (3 for) · 2 studies (1 review, 1 theoretical), q1–q2 · 0 of 2 report an effect size · 3 claims rest on one study

Description¶

This account explains rapid guessing not as a knowledge deficit or random noise but as a deliberate behavioral decision: the test taker chooses to stop engaging with the measurement process on an item. The authors state their assertion is "based on belief that rapid guessing on an item represents a test taker's choice to 'opt out' of the measurement process." Under this view, an opted-out response carries no measurement information, which motivates excluding it from scoring.

Design Implications¶

Context¶

Requirements¶

• Interpreting response-time thresholds as indicators of an intentional disengagement choice rather than ability.

Constraints¶

• Framed for computer-based achievement testing where rapid guesses are identifiable.

Target Learners¶

• Test takers on computer-based achievement tests

Target Learning Objectives¶

• Valid interpretation of achievement test scores

Claims¶

• Rapid Guessing Construct Irrelevant Response Process [+M]
• Rapid guessing differs from solution behavior as a form of test-taker disengagement [+W]
• Test takers generally disengage during only a portion of their items, and these disengaged responses reflect a momentary cessation of measurement [+W]

Related Theories¶

• Response-time-based identification of test taker disengagement (cessation of measurement)
• Rapid guessing as a momentary decision by the test taker to opt out of being measured
• Rapid-guessing detection framework using item response time thresholds

Examples¶

• Use response time to identify test taker disengagement as rapid-guessing behavior

Key Sources¶

• Steven Wise, Megan Kuhfeld. (2020). A cessation of measurement: Identifying test taker disengagement using response time. NWEA Research presentation, National Council on Measurement in Education 2020 virtual conference. https://www.nwea.org/research/publication/a-cessation-of-measurement-identifying-test-taker-disengagement-using-response-time/