NCME 2020 presentation on effort-moderated IRT parameter estimation accuracy¶

Element · All elements
Evidence · 1 claim (1 for) · 1 study (1 theoretical), q1 · 0 of 1 report an effect size · 1 claim rests on one study

Description¶

A presentation delivered at the 2020 National Council on Measurement in Education virtual conference by James Soland and Joseph Rios, listed by NWEA Research under the topics of "Measurement & scaling" and "School & test engagement". Its stated content is new research findings on understanding and managing test-taking disengagement, with the specific study examining parameter estimation accuracy of the effort-moderated IRT model under multiple assumption violations. The page links to the presentation but prints no slides, results, or methods detail.

Design Implications¶

Context¶

Requirements¶

• Access to the presentation materials themselves, which the page only links to via "See the presentation"

Constraints¶

• The page prints only a title, authors, date, and one-sentence description; no study results are available from this source

Target Learners¶

• K-12 students taking standardized assessments where test-taking disengagement occurs

Target Learning Goals¶

• Accurate measurement of student achievement in the presence of test-taking disengagement

Claims¶

• The effort-moderated IRT model's parameter estimation accuracy was studied under multiple assumption violations in the context of test-taking disengagement [+W]

Related Elements¶

• MAP Growth retest dataset for evaluating E-M scoring accuracy
• NWEA implementation of automated item generation (AIG) alongside traditional item-development approaches

Examples¶

-

Key Sources¶

• Soland, J. & Rios, J. (2020, September). Parameter estimation accuracy of the effort-moderated IRT model under multiple assumption violations. National Council on Measurement in Education 2020 virtual conference. https://www.nwea.org/research/publication/parameter-estimation-accuracy-of-the-effort-moderated-irt-model-under-multiple-assumption-violations/