Pilot Planning Checklist and Ideal Pilot Timeline artifacts¶

Element · All elements
Evidence · 1 claim (1 mixed) · 1 study (1 qualitative), q2 · 0 of 1 report an effect size · 1 claim rests on one study

Description¶

The report provides two planning artifacts for districts conducting ed-tech pilots: a pilot-planning checklist and a model pilot timeline, released as appendices. The recommendations state, "Create a pilot-planning checklist that includes a plan for getting started, pilot implementation, and planning for evaluation and next steps. See the Pilot Planning Checklist in Appendix F" and "Create a timeline for the pilot process that includes planning, implementation, procurement, and evaluation. See the Ideal Pilot Timeline in Appendix J." District documentation artifacts from the study (appendices A-E) also exemplify pilot process records.

Design Implications¶

Context¶

Requirements¶

• Districts need a plan covering getting started, pilot implementation, and evaluation and next steps, plus a timeline spanning planning, implementation, procurement, and evaluation.

Constraints¶

Target Learners¶

• K-12 school district administrators and pilot coordinators

Target Learning Goals¶

• Structured planning and evaluation of education technology pilots to support procurement decisions

Claims¶

• Districts defined pilot success differently, making it difficult to set a standard for evaluating product effects on student improvement [~W]

Related Elements¶

• EdTech Pilot Navigator with four pilot models (Resource E)

Examples¶

• Build formal feedback mechanisms and an evaluation plan into ed-tech pilots
• Conduct ed-tech pilots by articulating the instructional need, setting clear product-review criteria, involving educators in planning, supporting educators throughout, gathering data from all users, deciding from data, negotiating purchasing options, and sharing results

Key Sources¶

• Adams-Bass, V., Atchison, D., & Moore, L. (2015). Piloting Ed-tech Products in K-12 Public Schools: Pilot-to-Purchase Project. A Report from the University of California Davis School of Education to Digital Promise. https://digitalpromise.dspacedirect.org/items/38af8409-82b3-4f0e-baff-2a093963bada