Use secondary time thresholds to purify E-M scoring¶

Strategy · All strategies
Evidence · no claims cited

Description¶

Study 2 investigates a purification method for improving E-M score accuracy: varying the secondary time thresholds used to identify responses excluded during E-M scoring. The authors state the new method "is expected to improve our ability to estimate the score distortion caused by test-taking disengagement, thus enhancing the value of E-M scoring." This is a proposed refinement to threshold-based exclusion of rapid guesses.

Design Implications¶

Context¶

Requirements¶

• Access to response-time data and a retest or other criterion dataset to evaluate threshold choices.

Constraints¶

• Presented as expected, not yet demonstrated: the method is under investigation and its improvement is anticipated rather than shown in this text.

Target Learners¶

• K-12 students taking MAP Growth assessments

Target Learning Goals¶

• Accurate achievement scoring when test takers disengage

Related Strategies¶

Examples¶

-

Key Sources¶

• Wise, S., & Kuhfeld, M. (2020, September). Using retest data to evaluate and improve effort-moderated scoring. National Council on Measurement in Education virtual conference. https://www.nwea.org/research/publication/using-retest-data-to-evaluate-and-improve-effort-moderated-scoring-presentation/