Flagged items showed no clear pattern by original difficulty, spreading across the entire scale like unflagged items¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2022 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2025: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Original difficulty distributions of stable and unstable items show flagged items spread over the entire underlying scale in a similar manner as unflagged items, with Robust Z cut-off values between 0.34 and 0.51 logit across subjects. → He 2022
Evidence¶
He 2022¶
He, W. (2022). MAP Growth item parameter drift study. NWEA Research Report. https://www.nwea.org/research/publication/map-growth-item-parameter-drift-study/
q2 · i? · design · r2
Descriptive examination of histograms (Figure 3.5) plotting original item difficulty distributions for stable and unstable items across the four subjects. Histograms of difficulty differences (Figure 3.4) also showed items within 0.3 logit falling into the stable category, consistent with the 0.3 Logit Difference rule.
"These plots indicate that there was no clear pattern as to which items tended to be flagged, as flagged items in each subject spread out over their entire underlying scale in a similar manner as the unflagged items."
Discussion¶
Related Claims¶
- 13%–15% of MAP Growth items per subject were flagged as significantly drifted by the Robust Z procedure, with no clear pattern among flagged items — related
- Robust Z procedure flagged between 4.2% and 6.9% of MAP Growth items as unstable across subjects — related
- Both item-level and test-level analyses indicate the MAP Growth measurement scales are remaining stable — related
- The number of flagged items was unrelated to equating order, and flagged items showed no meaningful content-property pattern — related
- Average drift in MAP Growth item difficulty estimates is negligible across subjects, with original-new correlations above 0.99 — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
flagged-items-no-difficulty-pattern |
title |
Flagged items showed no clear pattern by original difficulty, spreading across the entire scale like unflagged items |
description |
Flagged items showed no clear pattern by original difficulty, spreading across the entire scale like unflagged items |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2022 |
source_checked |
2026-10-20 |
recheck_by |
2025 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — he-2022 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.