The number of flagged items was unrelated to equating order, and flagged items showed no meaningful content-property pattern¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Neither the order in which a test was equated to the bank nor content-specific properties showed a clear relationship with the number of items flagged by RMSD or the area measure. → Jungnam Kim 2017

Evidence¶

Jungnam Kim 2017¶

Jungnam Kim, Furong Gao, & Dong-In Kim. (2017). Robust IRT Scaling: Considerations in constructing item bank from tests across years. Paper presented at the annual meeting of the National Council on Measurement in Education, San Antonio, TX. https://www.nwea.org/research/publication/robust-irt-scaling-considerations-in-constructing-item-bank-from-tests-across-years/

q2 · i? · associational · r2

Secondary analysis in the Results section examining whether flagged-item counts related to equating order (Tables 4-6) or content properties. The authors also report that items flagged for both measures "were further reviewed for any potential content properties, but no meaningful pattern was found."

"With respect to the RMSD, Table 4 does not show a clear pattern between the equating order and the number of flagged items."

Discussion¶

Related Claims¶

• Flagged items showed no clear pattern by original difficulty, spreading across the entire scale like unflagged items — related
• Item parameter differences between chain and simultaneous equating were small (at most 12 items, 7%, flagged by RMSD), while comparisons involving concurrent calibration flagged up to 11% of items — related
• Summed scoring and IRT pattern scoring produce very similar scale score means and failing rates within any equating procedure — related