Computer-based testing's routine capture of item-level response times has driven increased interest in applications of response time to measuring ability and achievement¶

Claim · All claims
Evidence · 1 study · theoretical r2 · q1
Currency · newest study 2015 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q1 i? The growing presence of computer-based testing enables routine capture of time spent on individual items, leading to increased interest in applications of response time in measuring intellectual ability and achievement. → Steven Wise 2015

Evidence¶

Steven Wise 2015¶

Steven Wise. (2015). Response time as an indicator of test taker speed: assumptions meet reality. Measurement: Interdisciplinary Research and Perspectives, 13(3–4), 186–188. https://www.nwea.org/research/publication/response-time-as-an-indicator-of-test-taker-speed-assumptions-meet-reality doi:10.1080/15366367.2015.1105062

q1 · i? · theoretical · r2

Framing statement of the commentary: computer-based testing brought "the capability to routinely capture the time that test takers spend on individual test items", which led to increased interest in response-time applications. Descriptive, no effect size.

"The growing presence of computer-based testing has brought with it the capability to routinely capture the time that test takers spend on individual test items. This, in turn, has led to an increased interest in potential applications of response time in measuring intellectual ability and achievement."

Discussion¶

Related Claims¶

• The increased efficiency effect threatens the validity of response-time models that presume item response time is influenced only by item time intensity, ability, and working speed — related
• RTE provides an assessment of test-taking effort down to the level of individual item responses — related
• Time spent on very difficult math test items is highly correlated with students' academic motivation and self-efficacy — related
• Adding collateral information has little effect on ability and item parameter estimates but more effect on speed parameter estimates — related
• Rapid guessing can be identified from item-level response time, and its proper interpretation depends on contextual requirements — related
• The increased efficiency effect confounds attempts to exploit the speed-ability trade-off central to many response-time models — related
• Rapid guesses on computer-based tests reflect a construct-irrelevant response process rather than the tested knowledge, skills, and abilities — related
• Disengaged test taking materially impacts individual state summative test scores but may have relatively minor impact on score aggregations — related
• Test-taking disengagement distorts both individual and aggregated test scores — related
• Time students spend on math test questions is studied as a potential source of information about motivation and self-efficacy — related