Student test-taking disengagement on remotely administered adaptive interim assessments differs from disengagement on the same assessment administered in school¶

Claim · All claims
Evidence · 1 study · associational r? · q2
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Test-taking disengagement on a remotely administered adaptive interim assessment in spring 2020 differed from students' disengagement on the in-school fall 2019 administration. → Wise 2020

Evidence¶

Wise 2020¶

Wise, S. (2020). Validation and applications of rapid guessing to detect test taker disengagement. NWEA Research. https://www.nwea.org/research/publication/validation-and-applications-of-rapid-guessing-to-detect-test-taker-disengagement/

q2 · i? · associational · r?

The page's abstract reports a comparison study of disengagement on an adaptive interim assessment, contrasting "a remotely administered an adaptive interim assessment in spring 2020" with the in-school fall 2019 administration. No effect sizes or statistics are printed on the page.

"This study compared the test taking disengagement of students taking a remotely administered an adaptive interim assessment in spring 2020 with their disengagement on the assessment administered in-school during fall 2019."

Discussion¶

Related Claims¶

• American Indian/Alaska Native students showed higher disengagement under remote testing than in-school testing — a narrower finding that bears on this claim
• Disengaged test taking in international assessment programs threatens the validity of inferences about a country's educational attainment — related
• Student disengagement on an adaptive interim assessment gradually increased across grade level — related
• The grade-level disengagement pattern was not meaningfully different between remote and in-school testing — a narrower finding that bears on this claim
• The assessment's engagement feature had a consistently positive impact under both in-person and remote proctoring — related
• The dashboard primarily focuses on grades 3 through 8 because remote and in-person MAP Growth results are largely comparable for grades 3 and up — related
• A meaningful percentage of Grade 8 state summative test events showed rapid guessing, varying by subject: 5.5% in mathematics, 6.7% in ELA, and 3.5% in science — related
• Remote and in-person fall 2020 MAP Growth tests show comparable psychometric characteristics and indicators of test quality — related
• Test engagement was high across all grades on fall 2020 MAP Growth tests in both administration modes — related
• Course-specific test volumes dropped sharply in spring 2020 and hit record highs in 2021/22 — related
• Test disengagement could undermine inferences drawn from observed achievement scores — related
• Proctor notification after rapid-guessing detection improved test performance and yielded higher convergent validation evidence — related
• Rapid-guessing behavior on computer-based tests signals disengaged test taking that threatens score validity — related
• In-person proctored nursing cohorts achieved significantly higher HESI scores and NCLEX readiness than remotely proctored (ProctorU) cohorts — related
• Remote and in-person MAP Growth test scores showed consistent trends for students in grades 3-8 in fall 2020 — related
• Findings of reliability, engagement, and consistent score trends increase confidence in the quality of remotely administered MAP Growth data in grades 3 and up — related