Effort-moderated (E-M) scoring model¶
Research Method · All research methods
Evidence · 4 claims (2 for, 2 against) · 3 studies (2 associational, 1 design),q2· 0 of 3 report an effect size · 4 claims rest on one study
Description¶
The effort-moderated (E-M) model, attributed to Wise and DeMars (2006), is a scoring approach in which "rapid guesses are identified and excluded during scoring." It is "intended to estimate the score a disengaged test taker would have received had they been fully engaged." The presentation evaluates and seeks to improve this model using retest data from MAP Growth assessments.
Accounts¶
- Effort-moderated (E-M) scoring model: The effort-moderated (E-M) model, attributed to Wise and DeMars (2006), is a scoring approach in which "rapid guesses are identified and excluded during scoring." It is "intended to estimate the score a disengaged test taker would have received had they been fully engaged." The presentation evaluates and seeks to improve this model using retest data from MAP Growth assessments. (Using retest data to evaluate and improve effort-moderated scoring)
Claims¶
- E-M scoring partially accounts for observed RIT score differences between disengaged first tests and engaged retests [+M]
- Effort-moderated scoring estimates disengaged test takers' performance by excluding disengaged responses and scoring the remaining responses [+W]
- E-M scoring assumes the remaining responses are unaffected by disengagement, and this assumption can fail under partial engagement [-W]
- E-M scoring leaves residual score distortion, suggesting some disengaged test responses are nonrapid rather than rapid guesses [-W]
Related Research Methods¶
-
Key Sources¶
- Wise, S., & Kuhfeld, M. (2020, September). Using retest data to evaluate and improve effort-moderated scoring. National Council on Measurement in Education virtual conference. https://www.nwea.org/research/publication/using-retest-data-to-evaluate-and-improve-effort-moderated-scoring-presentation/
Page metadata
| Field | Value |
|---|---|
type |
research-method |
id |
effort-moderated-e-m-scoring-model |
title |
Effort-moderated (E-M) scoring model |
description |
The effort-moderated (E-M) model, attributed to Wise and DeMars (2006), is a scoring approach in which "rapid guesses are identified and excluded during scoring." It is "intended to estimate the score a disengaged test taker would have received had they been fully engaged." The presentation evaluate |
status |
review |
moved_from |
theory/effort-moderated-em-scoring-model |
generated |
by process:sweep-kinds on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — wise-s-kuhfeld-m |
Frontmatter is the page's machine-readable record — see the Schema & Guide.