The study examines how CAT test design and item bank distribution affect content coverage and test efficiency in a CCSS-aligned reading comprehension test¶
Claim · All claims
Evidence · 1 study · causalr?·q1
Currency · newest study 2016 · checked against its sources 2026-10-09 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q1 i? The paper investigates the effects of CAT test design and bank distribution on the content coverage and the efficiency of the tests. → Shudong Wang 2016
Evidence¶
Shudong Wang 2016¶
Shudong Wang, Hong Jiao. (2016). Effects of computerized adaptive test designs on content coverage and efficiency of reading comprehension test with passages aligned to Common Core State Standards. Presentation paper. https://www.nwea.org/research/publication/effects-of-computerized-adaptive-test-designs-on-content-coverage-and-efficiency-of-reading-comprehension-test-with-passages-aligned-to-common-core-state-standards/
q1 · i? · causal · r?
The article's stated purpose, as printed in its description: it investigates "the effects of CAT test design and bank distribution on the content coverage and the efficiency of the tests." No methods or results are printed in the available text, so no effect size is reported.
"The major purpose of this paper is to investigate the effects of CAT test design and bank distribution on the content coverage and the efficiency of the tests."
Discussion¶
Related Claims¶
- CAT data cannot be fit into factor models at the item level, making item-level construct validity investigation meaningless for CAT — related
- On-grade mathematics item pools yield larger SEMs and lower efficiency than all-grade pools for on-grade students, especially at the low end of the scale — related
- Item parceling at the testlet level substantially improves model fit, allowing partial (Rasch, 2PL) or full (bifactor) recovery of CAT constructs — related
- Adaptivity and score reliability of both engines depend on item-pool depth; the CBE often performed better than COLO for extreme low or high achievers when item banks were shallow — related
- CAT adjusts test questions as the testing goes along — related
- CAT development decisions influence and might threaten content alignment — related
- Procedures developed for evaluating content alignment of linear tests are not readily applicable to computerized adaptive tests — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
cat-design-and-bank-distribution-affect-coverage-and-efficiency |
title |
The study examines how CAT test design and item bank distribution affect content coverage and test efficiency in a CCSS-aligned reading comprehension test |
description |
The study examines how CAT test design and item bank distribution affect content coverage and test efficiency in a CCSS-aligned reading comprehension test |
status |
review |
evidence_strength |
weak |
newest_evidence |
2016 |
source_checked |
2026-10-09 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — shudong-wang-2016 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.