A CAT-sensitive process for evaluating content alignment¶
Research Method · All research methods
Evidence · 2 claims (1 for, 1 mixed) · 2 studies (1 causal, 1 associational),q1–q2· 0 of 2 report an effect size · 2 claims rest on one study
Description¶
The article outlines a process for evaluating content alignment that is sensitive to the particular ways computerized adaptive tests can diverge from their intended content domain. It adapts alignment evaluation, described as "key evidence for the validation of test score inferences", to tests that "require large item pools and do not use fixed test forms". The article presents the process and gives an empirical example of applying it.
Accounts¶
- A CAT-sensitive process for evaluating content alignment: The article outlines a process for evaluating content alignment that is sensitive to the particular ways computerized adaptive tests can diverge from their intended content domain. It adapts alignment evaluation, described as "key evidence for the validation of test score inferences", to tests that "require large item pools and do not use fixed test forms". The article presents the process and gives an empirical example of applying it. (Norman Webb (2015))
Claims¶
- The study examines how CAT test design and item bank distribution affect content coverage and test efficiency in a CCSS-aligned reading comprehension test [+W]
- CAT concentration is item-driven, not category-driven: removing the two vulnerable items collapses the procedural/conceptual odds ratio from 5.6 to 1.0 [~W]
Related Research Methods¶
-
Key Sources¶
- Norman Webb. (2015). Evaluating content alignment in computerized adaptive testing. Educational Measurement: Issues and Practice, 34(4), 41–18. https://onlinelibrary.wiley.com/journal/17453992
Page metadata
| Field | Value |
|---|---|
type |
research-method |
id |
a-cat-sensitive-process-for-evaluating-content-alignment |
title |
A CAT-sensitive process for evaluating content alignment |
description |
The article outlines a process for evaluating content alignment that is sensitive to the particular ways computerized adaptive tests can diverge from their intended content domain. |
status |
review |
moved_from |
theory/cat-sensitive-alignment-evaluation-process |
generated |
by process:sweep-kinds on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — norman-webb-2015 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.