Rank orderings of teachers do not change radically under mild scale transformations¶
Claim · All claims
Evidence · 1 study · associationalr?·q2
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? While value-added magnitudes shift with scale, the relative rank ordering of teachers is comparatively stable under mild transformations. → Soland 2017
Evidence¶
Soland 2017¶
Soland, J. (2017). Is teacher value added a matter of scale? The practical consequences of treating an ordinal scale as interval for estimation of teacher effects. Applied Measurement in Education, 30(1), 52–70. https://www.nwea.org/research/publication/is-teacher-value-added-a-matter-of-scale-the-practical-consequences-of-treating-an-ordinal-scale-as-interval-for-estimation-of-teacher-effects/ doi:10.1080/08957347.2016.1247844
q2 · i? · associational · r?
Re-estimation of teacher value added after applying mild nonlinear transformations showed that "rank orderings of teachers do not change radically by transformation." No effect size is printed for this finding.
"While rank orderings of teachers do not change radically by transformation, even mild departures from the original scale can change a teacher's odds of being considered high- or low-performing by a factor of 5."
Discussion¶
Related Claims¶
- Mild departures from the original scale can change a teacher's odds of being classified high- or low-performing by a factor of 5 — related
- Value-added teacher rankings are insensitive to correcting measurement error in the pretest, with correlations of 0.91–0.99 for elementary and 0.77–0.98 for middle school teachers — related
- Teacher value-added estimates are sensitive to the test scale on which they are computed — related
- Models with similar rank correlations differ substantially in estimating difficulty magnitude (RMSE and MAE) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
teacher-rank-orderings-robust-to-mild-transformations |
title |
Rank orderings of teachers do not change radically under mild scale transformations |
description |
Rank orderings of teachers do not change radically under mild scale transformations |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2017 |
generated |
by process:wiki-ingest on 2026-10-09 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — soland-2017 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.