Efficiently test school report card design changes at scale before adopting them¶

Strategy · All strategies
Evidence · 2 claims (2 for) · 1 study (1 causal), q2 · 0 of 1 report an effect size · 2 claims rest on one study

Description¶

The article presents its study as a template for education agencies considering changes to school report card design: rather than adopting a design on intuition, policymakers can run comparative usability tests of design variants and measure usability, understanding, findability, and satisfaction. The study "illustrates how policymakers and practitioners in other states can efficiently test school report card design changes at scale."

Design Implications¶

Context¶

Requirements¶

• Access to an online school report card whose design variants can be compared on usability, understanding, and satisfaction measures

Constraints¶

Target Learners¶

• Education policymakers and practitioners evaluating school report card designs

Target Learning Goals¶

• Making school performance information usable and understandable to parents and the public

Claims¶

• The combination of moving the STAR link and reporting points possible produced the best performance on all measures [+W]
• Moving the link to the STAR framework from the top of the page to beneath the STAR score improved the school report card site's usability [+W]

Related Strategies¶

• Weigh stated considerations before adopting computerized adaptive testing

Examples¶

-

Key Sources¶

• Jesse Chandler, Jacob Hartog, Erin Lipman, Jonathan Gellar. (2021). The Effect of School Report Card Design on Usability, Understanding, and Satisfaction. Regional Educational Laboratory Mid-Atlantic, U.S. Department of Education, Institute of Education Sciences. https://ies.ed.gov/ncee/edlabs