Within a single administration, COLO administered more items and overexposed fewer items than the CBE, likely due to its randomesque exposure-control procedure¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2021 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2024: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? More items in the item bank were administered and fewer items were overexposed by COLO than by the CBE within the same administration. → Hu 2021
Evidence¶
Hu 2021¶
Hu, A., Chien, M., & Meyer, P. (2021). Comparability of MAP Growth tests administered through different technology and psychometric infrastructure: A simulation study. NWEA. https://www.nwea.org/research/publication/comparability-of-map-growth-tests-administered-through-different-technology-and-psychometric-infrastructure-a-simulation-study/
q2 · i? · design · r2
Item exposure rates within an administration were computed for each item in the pool (Tables 4.7–4.15) for both engines. The report attributes the difference to the randomesque procedure "implemented on COLO but not on the CBE."
"Within the same administration, more items in the item bank were administered and less items were overexposed by COLO than by the CBE. This is likely due to the randomesque procedure implemented on COLO but not on the CBE to control item exposure."
Discussion¶
Related Claims¶
- Across administrations, the CBE may re-administer an item to the same student before the longitudinal exposure window elapses when the item bank cannot fulfill test requirements, which COLO does not allow — related
- Adaptivity and score reliability of both engines depend on item-pool depth; the CBE often performed better than COLO for extreme low or high achievers when item banks were shallow — related
- Item exposure rates are comparable across engines, with most items below 10%, and the CBE Reading item-use rate is lower than COLO's — related
- Test lengths are comparable across engines, but CBE test durations are higher than COLO's in both terms and content areas, more prominently in Reading — related
- CBE shows better engine adaptivity than COLO, especially for extremely low or high achievement students — related
- Differences in test-taking engagement across content categories were primarily due to differences in the reading load of items — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
colo-better-within-administration-item-exposure |
title |
Within a single administration, COLO administered more items and overexposed fewer items than the CBE, likely due to its randomesque exposure-control procedure |
description |
Within a single administration, COLO administered more items and overexposed fewer items than the CBE, likely due to its randomesque exposure-control procedure |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2021 |
source_checked |
2026-10-20 |
recheck_by |
2024 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — hu-2021 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.