Manipulation trials were excluded from performance scoring to preserve WAIS-III validity¶

Claim · All claims
Evidence · 1 study · causal r2 · q2
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The authors did not use manipulation trials as performance measures because doing so would have violated WAIS-III administration guidelines and prevented valid standardized scoring. → Test Boredom While Working on Difficult Versus Easy Tasks: Online Supplementary Materials 2022

Evidence¶

Test Boredom While Working on Difficult Versus Easy Tasks: Online Supplementary Materials 2022¶

Test Boredom While Working on Difficult Versus Easy Tasks: Online Supplementary Materials. (2022). https://www.google.com/search?q=%22Test+Boredom+While+Working+on+Difficult+Versus+Easy+Tasks%22

q2 · i? · causal · r2

Supplemental Material S3 (Study 2) gives three reasons manipulation trials were not used to calculate performance scores: adherence to "the guidelines for the WAIS-III to ensure validity," floor and ceiling effects of the very easy (2-3 digit) and very difficult (8-9 digit) tasks, and the impossibility of transforming resulting scores into standardized WAIS-III scores.

"for the performance measure, we wanted to adhere as closely as possible to the guidelines for the WAIS-III to ensure validity. This would not have been possible with only using very easy or very difficult items, as included in the manipulation trials."

Discussion¶

Related Claims¶

• Effort-moderated scoring estimates disengaged test takers' performance by excluding disengaged responses and scoring the remaining responses — related
• Current measurement models underlying achievement testing assume students respond effortfully to test items — related
• E-M scoring assumes the remaining responses are unaffected by disengagement, and this assumption can fail under partial engagement — related