Computerized adaptive tests (CATs) as a motivational design feature in low-stakes assessment¶

Element · All elements
Evidence · 4 claims (4 for) · 2 studies (1 review, 1 theoretical), q1–q2 · 0 of 2 report an effect size · 4 claims rest on one study

Description¶

Computerized adaptive tests (CATs) are a test-delivery format in which item selection adapts to the examinee, and the article evaluates them as a design feature with motivational benefits in low-stakes testing. The review "examines the motivational benefits of computerized adaptive tests (CATs)" and concludes they hold advantages over conventional tests for detecting low examinee effort and addressing the resulting validity threat. The element is treated here as the assessment technology whose motivational properties the review synthesizes.

Design Implications¶

Context¶

Requirements¶

• Computerized administration with adaptive item selection

Constraints¶

• Benefits are argued for low-stakes testing contexts

Target Learners¶

• Examinees in low-stakes testing programs

Target Learning Goals¶

• Accurate measurement of examinee ability under variable motivation

Claims¶

• CATs can effectively address the validity threat posed by unmotivated examinees in low-stakes testing [+W]
• CATs can have important advantages over conventional tests in identifying instances when examinees exhibit low effort [+W]
• Unmotivated examinees present a major threat to the validity of scores in low-stakes testing programs [+W]
• CAT has the potential to be more valid and reliable than non-adaptive tests [+W]

Related Elements¶

• Computerized adaptive testing (CAT) as an assessment component

Examples¶

-

Key Sources¶

• Steven Wise. (2014). The utility of adaptive testing in addressing the problem of unmotivated examinees. Journal of Computerized Adaptive Testing, 2(1), 1–17. https://www.nwea.org/research/publication/the-utility-of-adaptive-testing-in-addressing-the-problem-of-unmotivated-examinees/