Skip to content

Rapid-guessing detection using item response-time thresholds

Research Method · All research methods
Evidence · 6 claims (5 for, 1 mixed) · 5 studies (3 associational, 1 design, 1 theoretical), q1–q3 · 0 of 5 report an effect size · 6 claims rest on one study

Description

This framework identifies disengaged item responses on computer-based tests using response times—the seconds between item presentation and answer. Responses are "often termed “rapid guessing” because responses are, when effectively detected, correct at a rate no better than chance." Thresholds separate engaged from disengaged responses (e.g., 10% of average item response time, maximum 10 seconds), and student engagement is summarized as the proportion of non-rapid responses. The paper applies this framework to flag disengaged test events (rapid guessing on 10% or more of items) and re-estimate achievement for evaluation metrics.

Accounts

  • Rapid-guessing detection framework using item response time thresholds: This framework identifies disengaged item responses on computer-based tests using response times—the seconds between item presentation and answer. Responses are "often termed “rapid guessing” because responses are, when effectively detected, correct at a rate no better than chance." Thresholds separate engaged from disengaged responses (e.g., 10% of average item response time, maximum 10 seconds), and student engagement is summarized as the proportion of non-rapid responses. The paper applies this framework to flag disengaged test events (rapid guessing on 10% or more of items) and re-estimate achievement for evaluation metrics. (Kuhfeld et al. (2019))
  • Item response time as a measure of examinee test-taking effort classifying rapid-guessing versus solution behavior: Computer-based testing enables measuring examinee effort through response times: "At the item level, responses can be classified as exhibiting either rapid-guessing behavior or solution behavior based on the item response time." This study applied that classification approach to a commercially available, low-stakes instrument rather than the locally developed instruments used in most prior response-time research. (Steven Wise et al. (2013))

Claims

-

Key Sources

  • Kuhfeld, M. & Soland, J. (2019). Using Assessment Metadata to Quantify the Impact of Test Disengagement on Estimates of Educational Effectiveness. (The Collaborative for Student Growth at NWEA Working Paper). https://www.nwea.org/research/publication/using-assessment-metadata-to-quantify-the-impact-of-test-disengagement-on-estimates-of-educational-effectiveness-paper/
  • Steven Wise, J. Carl Setzer, Jill R. van den Heuvel, Guangming Ling. (2013). An investigation of examinee test-taking effort on a large-scale assessment. Applied Measurement in Education, 26(1), 34–49. https://www.nwea.org/research/publication/an-investigation-of-examinee-test-taking-effort-on-a-large-scale-assessment/
Page metadata
Field Value
type research-method
id rapid-guessing-detection-using-item-response-time-thresholds
aliases response-time-classification-of-rapid-guessing-versus-solution-behavior
title Rapid-guessing detection using item response-time thresholds
description This framework identifies disengaged item responses on computer-based tests using response times—the seconds between item presentation and answer.
status review
moved_from theory/rapid-guessing-response-time-threshold-framework
generated by process:sweep-kinds on 2026-10-10
trust unverified — no one has confirmed this page's content
sources 2 — kuhfeld-2019, steven-wise-2013

Frontmatter is the page's machine-readable record — see the Schema & Guide.