Conduct a small pilot study to assess early evidence of success before full validation¶

Strategy · All strategies
Evidence · no claims cited

Description¶

Phase 3 of the evidence-building process prescribes running a small pilot study as the mechanism for early evidence gathering. The document "describes how to conduct a small pilot study and demonstrate that a solution is associated with improved outcomes for students in a priority community." This sits between refining a solution (Phase 2) and validating effectiveness (Phase 4), providing an intermediate test before larger validation efforts.

Design Implications¶

Context¶

Requirements¶

• A solution that has already been designed and refined in Phases 1 and 2

Constraints¶

• A pilot demonstrates association with improved outcomes, not validated effectiveness, which is reserved for Phase 4

Target Learners¶

• students in a priority community

Target Learning Goals¶

• early evidence of improved student outcomes

Related Strategies¶

• Conduct a large pilot study to validate effectiveness with high confidence
• Plan sample sizes phase by phase across the four evidence-building phases

Examples¶

-

Key Sources¶

• Ruggiero, R., Manley, M., Knechtel, V., Place, K., & Shoji, M. (2023). Measurement and Evaluation Checklist: Assess for Early Evidence of Success (Phase 3). Mathematica. https://www.mathematica.org/publications/measurement-and-evaluation-checklist-assess-for-early-evidence-of-success-phase-3