Information-based rapid-guessing threshold methods set thresholds more reliably than methods based on response accuracy or visual inspection¶
Claim · All claims
Evidence · 1 study · designr2·q3
Currency · newest study 2019 · checked against its sources 2026-10-09 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2022: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? In an empirical comparison study, the new information-based threshold methods more reliably set rapid-guessing thresholds than methods based on response accuracy or visual inspection of response-time distributions. → Wise 2019
Evidence¶
Wise 2019¶
Wise, S. (2019). An information-based approach to identifying rapid-guessing thresholds. Applied Measurement in Education, 32(4), 325-336. https://www.nwea.org/research/publication/an-information-based-approach-to-identifying-rapid-guessing-thresholds/
q3 · i? · design · r2
Peer-reviewed journal study comparing threshold methods for rapid-guessing identification. The abstract reports that "an empirical comparison study found the new methods to more reliably set thresholds than methods based on response accuracy or visual inspection." No effect size is printed in the available text.
"A pair of information-based methods are introduced, and an empirical comparison study found the new methods to more reliably set thresholds than methods based on response accuracy or visual inspection."
Discussion¶
Related Claims¶
- Response-time threshold-setting methods for detecting noneffortful item responses were compared using reading scores from over 728,923 US students in 2,056 schools — related
- Threshold-setting methods are compared using reading scores from over 728,923 students on a computer-adaptive test of nearly 12,000 items — related
- Detecting noneffortful responses requires setting response time thresholds that separate effortful from noneffortful responses — a broader claim this one bears on
- Prior threshold-method comparison studies typically used simulated or small-scale data, or non-CAT large-scale data with few items — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
information-based-thresholds-more-reliable-than-accuracy-visual-methods |
title |
Information-based rapid-guessing threshold methods set thresholds more reliably than methods based on response accuracy or visual inspection |
description |
Information-based rapid-guessing threshold methods set thresholds more reliably than methods based on response accuracy or visual inspection |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2019 |
source_checked |
2026-10-09 |
recheck_by |
2022 |
generated |
by process:wiki-ingest on 2026-10-09 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — wise-2019 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.