Outlier rates in Spanish item calibration are extremely low, which the authors take as evidence of very high calibration quality¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2023: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Of 3,955 collected items, 47 (about 1.1%) exceeded the 20-RIT selection criterion; 28 of 1,166 status 10 items (2.4%) and 8 of 2,770 status XX items (0.2%) were outliers. → Wang 2020
Evidence¶
Wang 2020¶
Wang, S., & Li, S. (2020). Calibration of Spanish MAP Growth math tests. Portland, OR: NWEA. https://www.nwea.org/research/publication/calibration-of-spanish-map-growth-math-tests/
q2 · i? · design · r2
Item selection analysis of the collected versus selected samples (Tables 2.2 and 2.3), filtering items whose old and new RITs differ by more than 20 RITs. The article reports 47 outlier items overall, 28 status 10 outliers (2.4%) and 8 status XX outliers (0.2%); all status 12 and 13 items were outliers. No effect size is printed.
"These rates of outliers by calibration status are extremely low, which proves that the quality of the calibration of Spanish math items using Spanish test responses is extremely high."
Discussion¶
Related Claims¶
- Adaptive testing explains why about one third of calibrated Spanish math items carry calibration status 10 — related
- Old (English-borrowed) and newly calibrated Spanish item RITs differ negligibly, with correlations of 0.98 and no statistically significant paired t-test differences — related
- Students' surprise at measurement values was overwhelmingly expressed by identifying an outlier or extreme/unusual value — related
- Including or excluding calibration status 10 items in scoring has a negligible impact on Spanish student RIT scores for monolingual and bilingual students — related
- Rescoring with new item parameters changed average ability estimates negligibly, with new and original scores correlated above 0.99 — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
spanish-calibration-outlier-rates-extremely-low |
title |
Outlier rates in Spanish item calibration are extremely low, which the authors take as evidence of very high calibration quality |
description |
Outlier rates in Spanish item calibration are extremely low, which the authors take as evidence of very high calibration quality |
status |
review |
evidence_strength |
weak |
newest_evidence |
2020 |
recheck_by |
2023 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — wang-2020 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.