Adapt translated assessments to the target jurisdiction's linguistic and cultural characteristics, and revise administration scripts and timing to fit test-takers unfamiliar with the format.¶

Strategy · All strategies
Evidence · 1 claim (1 for) · 1 study (1 associational), q2 · 0 of 1 report an effect size · 1 claim rests on one study

Description¶

For the 2005 Puerto Rico NAEP administration, the report describes enhancements to translation and administration after 2003 data-quality concerns. Key changes were "the addition of two Puerto Rican mathematics teachers to the expert review panel" and "adaptation of topics and language usage to incorporate the unique linguistic and cultural characteristics of Puerto Rico." The administration script was revised to give explicit directions to move on and to explain item types, and testing time was extended from 50 to 70 minutes for the two mathematics sections.

Design Implications¶

Context¶

Requirements¶

• Expert review panel including teachers from the target language community
• Revised administration script with explicit directions and explanations of item types
• Additional testing time for students unfamiliar with the assessment format

Constraints¶

• Because of translation changes made to the 2005 assessment, Puerto Rico results from 2003 cannot be compared with those of 2005, so adapted administrations are not comparable across versions.

Target Learners¶

• Fourth- and eighth-grade public school students in Puerto Rico

Target Learning Goals¶

• Valid measurement of mathematics achievement in the language of instruction

Claims¶

• Preliminary analyses of the 2003 Puerto Rico data led to changes in administration and translation procedures for the 2005 assessment [+W]

Related Strategies¶

• Integrate Puerto Rico into the national NAEP sample in future administrations
• Adapt English-language KEA administration so students may respond in Spanish or English, with bilingual directions and Spanish-adapted rather than merely translated prompts

Examples¶

-

Key Sources¶

• Baxter, G.P., Bleeker, M.M., Waits, T.L., Salvucci, S. (2007). The Nation's Report Card: Mathematics 2003 and 2005 Performance in Puerto Rico—Highlights (NCES 2007–459). U.S. Department of Education, National Center for Education Statistics, Washington, D.C. http://nationsreportcard.gov/puertorico_2005/