One measurement article argues that low test-taking motivation biases an individual student's achievement test score downward¶

Claim · All claims
Evidence · 1 study · theoretical r? · q2
Currency · newest study 2015 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2018: tool and model accuracy changes quickly

Subclaims¶

q2 i? Non-effortful test taking driven by low test-taking motivation produces a systematic negative bias in an individual student's achievement score. → Steven Wise 2015

Evidence¶

Steven Wise 2015¶

Steven Wise. (2015). Effort analysis: Individual score validation of achievement test data. Applied Measurement in Education, 28(3), 237–252. https://www.nwea.org/research/publication/effort-analysis-individual-score-validation-of-achievement-test-data/

q2 · i? · theoretical · r?

The article's abstract frames test-taking motivation as a construct-irrelevant factor, stating it "tends to induce a person-specific, systematic negative bias on test scores." No effect size or empirical statistic is printed in the available text.

"This article examines one such factor—test-taking motivation—that tends to induce a person-specific, systematic negative bias on test scores."

Studies bearing on this claim¶

Does disengaged test taking (rapid guessing, low effort) distort scores, and when does it matter for the decision? This table gathers the studies behind this claim and the 6 narrower claims that bear on it: 4 distinct studies (3 theoretical, 1 causal), q2–q3, 0 of 4 with an effect size coded. One row per study, codes as each entry records them; no effect is averaged and no verdict is drawn. Built by scripts/synthesize_claim.py from eval/synthesis/; a row that looks wrong is fixed on the claim it comes from.

Discussion¶

Related Claims¶

• Effort-moderated scoring yields more accurate achievement scores and better person fit than traditional MLE scoring when rapid guessing is present — related
• Filtered students had much lower effort-moderated achievement, suggesting motivation filtering may bias mean estimates — related
• In simulation, effort-moderated scoring (EM-CAT and EG-CAT) yields negligible bias and nominal 95% confidence interval coverage, unlike MLE-CAT scoring — related
• Disengagement produced both positive and negative distortion of individual student scores, which tended to cancel out much of the net distortive effect on school means — reports the opposite
• Effort-moderated scoring yields more accurate scores than traditional scoring on an adaptive achievement test — related
• Effort-moderated scoring exhibits improved person fit statistics compared with traditional scoring — related
• Differential student test effort may bias achievement gap estimates — related
• School-level aggregated scores on the computer-based PISA-Based Test for Schools were highly stable despite considerable differential engagement among schools — related
• Differing response styles create a construct-irrelevant source of bias that distorts fundamental inferences made from survey data — related
• Rapid-guessing behavior can distort test scores and adversely affect measurement — a broader claim this one bears on
• Rapid guesses on computer-based tests reflect a construct-irrelevant response process rather than the tested knowledge, skills, and abilities — related
• Differential rapid guessing often resulted in test events with meaningfully distorted item content representation — related
• Disengaged responding biases observed scores from achievement tests and surveys in practically and statistically significant ways — a broader claim this one bears on