Ed-tech companies should use multi-method, multi-stakeholder research at every product stage and share results publicly¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The report's closing recommendations enumerate promising practices: consult "multiple learning science research resources across different disciplines", form a scientific advisory board, "Conduct user research using multiple methods and with multiple different stakeholder groups, and iterate quickly", find a partner research organization, use a comparison group and randomization when possible, consider partnering toward peer-reviewed publication, and share research results publicly. The recommendations are grounded in the practices of high-scoring campaign submissions.

Design Implications¶

Context¶

Requirements¶

• Requires access to research partners, advisory experts, or on-staff research expertise, and willingness to share results publicly

Constraints¶

• The report notes randomization can be difficult in school settings and that journal publication timelines often extend beyond product development cycles

Target Learners¶

• K-12 students using ed-tech products

Target Learning Goals¶

• Building more engaging, effective, and evidence-grounded educational technology products

Affordances¶

• Three Stage Edtech Research Framework

Related Strategies¶

• Conduct ed-tech pilots by articulating the instructional need, setting clear product-review criteria, involving educators in planning, supporting educators throughout, gathering data from all users, deciding from data, negotiating purchasing options, and sharing results
• Dissemination planning and accurate, accessible data visualization
• AI researchers should partner with developers and disseminate findings accessibly to bridge research-practice silos

Examples¶

-

Key Sources¶

• Simone, C. M., & Gross, K. (2017). Using Research in Ed-Tech: How ed-tech companies use research to make better products. Digital Promise. https://digitalpromise.dspacedirect.org/items/82489735-de61-4d86-bf04-5ebdfbb15f10