Item parameter differences between chain and simultaneous equating were small (at most 12 items, 7%, flagged by RMSD), while comparisons involving concurrent calibration flagged up to 11% of items¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? For tests prior to 2009F, RMSD flagged fewer items between CH and SM (with two exceptions of 2005S and 2006S, a maximum of 12 items, 7%) than between either transformation and CR (up to 11% of items). → Jungnam Kim 2017
Evidence¶
Jungnam Kim 2017¶
Jungnam Kim, Furong Gao, & Dong-In Kim. (2017). Robust IRT Scaling: Considerations in constructing item bank from tests across years. Paper presented at the annual meeting of the National Council on Measurement in Education, San Antonio, TX. https://www.nwea.org/research/publication/robust-irt-scaling-considerations-in-constructing-item-bank-from-tests-across-years/
q2 · i? · design · r2
Item-level RMSD analysis reported in Table 4 for all dichotomous items across the 45 administrations. The authors call the larger CR flagging counts "somewhat expected considering large differences in the scale score statistics with the CR results."
"With two exceptions of the tests 2005S and 2006S, a maximum of 12 items (7%) were flagged when comparing CH and SM. Between CH and CR and between SM and CR, more items were flagged in general (up to 11% of items)."
Discussion¶
Related Claims¶
- Concurrent calibration produced higher and less fluctuating failing rates than the separate-calibration equating transformations, with larger differences for older tests — related
- Concurrent calibration yielded consistently lower and less fluctuating scale score means than separate calibration with chain or simultaneous equating, especially for older tests — related
- The number of flagged items was unrelated to equating order, and flagged items showed no meaningful content-property pattern — related
- Summed scoring and IRT pattern scoring produce very similar scale score means and failing rates within any equating procedure — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
rmsd-fewer-flagged-items-ch-vs-sm-than-cr |
title |
Item parameter differences between chain and simultaneous equating were small (at most 12 items, 7%, flagged by RMSD), while comparisons involving concurrent calibration flagged up to 11% of items |
description |
Item parameter differences between chain and simultaneous equating were small (at most 12 items, 7%, flagged by RMSD), while comparisons involving concurrent calibration flagged up to 11% of items |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2017 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — jungnam-kim-2017 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.