Changes in school composition over time during the COVID-19 pandemic may contaminate school-aggregate test scores and produce faulty comparisons with historical and proximal aggregate scores¶
Claim · All claims
Evidence · 1 study · associationalr?·q2
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2025: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Changes in school composition over time are a specific issue that may contaminate COVID-19-era school-aggregate scores and result in faulty comparisons with historical and other proximal aggregate scores. → Jonathan Schweig 2022
Evidence¶
Jonathan Schweig 2022¶
Jonathan Schweig, Megan Kuhfeld, Andrew McEachin, Melissa Diliberti, Louis Mariano. (2022). Changes in school composition during the COVID-19 pandemic: Implications for school-average interim test score use. NWEA Research. https://www.nwea.org/research/publication/changes-in-school-composition-during-the-covid-19-pandemic-implications-for-school-average-interim-test-score-use/ doi:10.7249/rra1037-2
q2 · i? · associational · r?
The report's own framing of its investigation: an analysis of NWEA MAP Growth interim assessment data from the 2020-2021 school year targeting school composition change as a contamination source. The article states this issue "may contaminate utilization of COVID-19–era school-aggregate scores". No effect size is printed in the supplied text.
"RAND researchers investigate one specific issue that may contaminate utilization of COVID-19–era school-aggregate scores and result in faulty comparisons with historical and other proximal aggregate scores: changes in school composition over time."
Discussion¶
Related Claims¶
- Interpreting differences in school-aggregate test scores as real differences in school performance raises accuracy concerns even under routine schooling conditions, which the pandemic may exacerbate — a broader claim this one bears on
- School officials regularly use school-aggregate test scores to monitor school performance and make policy decisions — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
covid-school-composition-changes-contaminate-aggregate-scores |
title |
Changes in school composition over time during the COVID-19 pandemic may contaminate school-aggregate test scores and produce faulty comparisons with historical and proximal aggregate scores |
description |
Changes in school composition over time during the COVID-19 pandemic may contaminate school-aggregate test scores and produce faulty comparisons with historical and proximal aggregate scores |
status |
review |
evidence_strength |
weak |
newest_evidence |
2022 |
recheck_by |
2025 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — jonathan-schweig-2022 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.