Measure student learning between school years using remote test administration when in-person testing is disrupted¶

Strategy · All strategies
Evidence · 6 claims (4 for, 2 mixed) · 5 studies (3 associational, 1 review, 1 theoretical), q1–q3 · 0 of 5 report an effect size · 6 claims rest on one study

Description¶

The presentation describes ongoing work to quantify pandemic learning effects by measuring student learning between the 2019-20 and 2020-21 school years "in the context of mostly remote test administration this fall". This strategy adapts routine fall assessment to disrupted conditions so that learning loss can be observed rather than only projected. It was used alongside projection work grounded in prior missing-school research.

Design Implications¶

Context¶

Requirements¶

• A remote-administrable assessment such as MAP Growth

Constraints¶

• Applies in the context of mostly remote test administration during pandemic disruption

Target Learners¶

• K-12 students in US schools during 2020-21

Target Learning Goals¶

• Measuring math and reading achievement change across the 2019-20 to 2020-21 school years

Claims¶

• Average fall 2021 math scores in Grades 3–8 were .20–.27 SD lower than same-grade peers' fall 2019 scores [+W]
• The visualizations address how students performed in fall 2020 compared to a typical school year [~W]
• Students showed lower math growth in fall 2020 across grades 3-8 relative to peers in the previous, more typical year [+W]
• Approximately one in four students who tested the prior year were missing from fall 2020 data, disproportionately Black or Latinx students in higher-poverty schools, so prior estimates likely understated pandemic impacts [~W]
• Remote proctoring supported assessment continuity and uninterrupted student progression during institutional closures [+W]
• Student growth measures describe gains in student learning based on how much students' test scores changed over a school year [+W]

Related Strategies¶

Examples¶

-

Key Sources¶

• Megan Kuhfeld. (2020). Projecting the impact of the COVID-19 spring school closures on student learning. NWEA Research presentation. https://www.nwea.org/research/publication/projecting-the-impact-of-the-covid-19-spring-school-closures-on-student-learning/