The dashboard's cross-sectional view compares same-grade students across terms using the full sample of testers, but attrition is not random¶
Claim · All claims
Evidence · 1 study · associationalr2·q2
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2024: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The cross-sectional analysis examines how students performed in one term relative to same-grade students in a prior term, using the full sample of students who tested at each term, and the guide warns that observed student attrition is not random. → User guide for interpreting the NWEA state dashboard: Exploring the educational impacts of COVID-19 2021
Evidence¶
User guide for interpreting the NWEA state dashboard: Exploring the educational impacts of COVID-19 2021¶
User guide for interpreting the NWEA state dashboard: Exploring the educational impacts of COVID-19. (2021). NWEA Center for School and Student Progress. https://www.nwea.org/research/publication/user-guide-for-interpreting-the-nwea-state-dashboard-exploring-the-educational-impacts-of-covid-19/
q2 · i? · associational · r2
The guide's methodological explanation of the cross-sectional view states it shows "term-over-term changes in student outcomes using the full sample of students who tested at each term," while noting samples may differ between terms because some schools tested in one term but not the other.
"This approach allows us to show term-over-term changes in student outcomes using the full sample of students who tested at each term."
Discussion¶
Related Claims¶
- The dashboard's cohort view restricts results to students who consistently tested across selected terms, and those outcomes may be positively biased — related
- Systematic attrition differences mean COVID-19 impacts on student achievement are likely underestimated in fall 2020 MAP Growth results — related
- Attrition was concentrated in schools with higher concentrations of racial/ethnic minorities and socioeconomically disadvantaged students — related
- State-level dashboard results are reported only when at least 20% of students were tested across most grades and the sample contains at least 10 students — related
- Progressively larger treatment estimates among intervention students crossing engagement thresholds are hypothesis-generating only — related
- Sensitivity analyses restricting to students assessed in all 15 terms reproduced the full-sample between-group comparisons — related
- Systematic demographic differences in available fall 2020 assessment data suggest COVID-19 impacts on the most vulnerable students may be underestimated — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
cross-sectional-view-full-sample-attrition-caveat |
title |
The dashboard's cross-sectional view compares same-grade students across terms using the full sample of testers, but attrition is not random |
description |
The dashboard's cross-sectional view compares same-grade students across terms using the full sample of testers, but attrition is not random |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2021 |
recheck_by |
2024 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — user-guide-for-interpreting-the-nwea-state-dashboard-exploring-the-educational-impacts-of-covid-19-2021 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.