Proctor notification feature for detecting and responding to student disengagement¶

Element · All elements
Evidence · 5 claims (5 for) · 4 studies (2 causal, 1 associational, 1 design), q2–q3 · 0 of 4 report an effect size · 5 claims rest on one study

Description¶

A notification mechanism within a testing platform that alerts proctors when students disengage. The brief describes research on "student test engagement" showing "how proctor notification can make a significant impact," presenting the notification as a component of the assessment system that supports test-day monitoring of engagement.

Design Implications¶

Context¶

Requirements¶

• Integration with a testing platform capable of signaling disengagement events to proctors

Constraints¶

Target Learners¶

• K-12 students taking standardized tests

Target Learning Goals¶

• Valid assessment scores reflecting students' best effort

Claims¶

• Proctor notification after rapid-guessing detection improved test performance and yielded higher convergent validation evidence [+W]
• After a proctor notification triggered by rapid-guessing detection, test-taking engagement tended to increase [+W]
• The assessment's engagement feature had a consistently positive impact under both in-person and remote proctoring [+W]
• The test platform detects rapid guessing in real time and attempts to re-engage disengaged students to protect score validity [+W]
• Proctor notification when students disengage makes a significant impact on student test engagement [+W]

Related Elements¶

• Effort monitoring with proctor notification feature for computer-based tests

Examples¶

• Notify test proctors when students disengage so students give their best effort on testing day
• Use automated disengagement detection with proctor notification during remote low-stakes testing

Key Sources¶

• Steven Wise, Megan Kuhfeld, James Soland. (2019). The impact of proctor notification when students disengage. NWEA Research brief. https://www.nwea.org/research/publication/the-impact-of-proctor-notification-when-students-disengage/