The 2003 Puerto Rico assessment data showed problems with item misfit¶

Claim · All claims
Evidence · 1 study · associational r? · q2
Currency · newest study 2007 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2010: tool and model accuracy changes quickly

Subclaims¶

q2 i? The 2003 trial assessment data exhibited problems with item misfit. → G.P. Baxter 2007

Evidence¶

G.P. Baxter 2007¶

G.P. Baxter, S. Ahmed, E. Sikali, T. Waits, M. Sloan, S. Salvucci. (2007). Technical Report of the NAEP Mathematics Assessment in Puerto Rico: Focus on Statistical Issues. Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education. https://www.mathematica.org/publications/technical-report-of-the-naep-mathematics-assessment-in-puerto-rico-focus-on-statistical-issues

q2 · i? · associational · r?

The abstract lists as report content "problems with item misfit in the 2003 data," indicating that statistical analyses of the 2003 administration identified items that misfit. No misfit statistics or affected item counts are printed in the available text.

"This report describes the content and administration of the trial assessments in Puerto Rico in 2003 and 2005, problems with item misfit in the 2003 data, results of a special validity analysis, and plans to integrate Puerto Rico into the national sample in future administrations."

Discussion¶

Related Claims¶

• A special validity analysis was conducted on the Puerto Rico trial assessment data — related
• Preliminary analyses of the 2003 Puerto Rico data led to changes in administration and translation procedures for the 2005 assessment — related
• A trial Spanish-language NAEP mathematics assessment was administered to Puerto Rico public school students in grades 4 and 8 in 2003 — related
• The vast majority of Spanish Math (91%) and Reading (98%) items show no misfit across fall, winter, and spring terms — related