Measure usability, usefulness, and utilization during development and early implementation¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The guide recommends timing 3Us measurement early: it states that understanding the three indicators "is critical for implementing organizations and their funders, especially during development and early implementation." Measuring during these phases lets teams refine a solution while changes are still inexpensive, before full scale-up locks in design decisions.

Design Implications¶

Context¶

Requirements¶

• Access to implementing organizations and their funders during the development and early implementation phases
• Measurement tools for the three indicators

Constraints¶

• The recommendation is tied to the development and early implementation window; the guide does not describe later-phase measurement in the available text

Target Learners¶

• grantees developing and scaling educational solutions

Target Learning Goals¶

• timing implementation measurement to inform solution refinement

Affordances¶

• 3Us Framework Usability Usefulness Utilization

Related Strategies¶

• Funders should develop learning goals, plan their M&E approach, and communicate expectations before releasing an RFP and awarding grants
• Use a suite of measurement and evaluation tools to develop, refine, and scale evidence-based educational solutions
• Plan sample sizes phase by phase across the four evidence-building phases

Examples¶

-

Key Sources¶

• Mikia Manley, Virginia Knechtel, Kate Place, Andrew Gothro, Ryan Ruggiero. (2023). Guide to Measuring Implementation: The 3Us – Usability, Usefulness, Utilization. Mathematica. https://www.mathematica.org/publications/guide-to-measuring-implementation-the-3us-usability-usefulness-utilization