Report evaluation results with implementation and context details so schools can judge fit, and use measures educators value¶

Strategy · All strategies
Evidence · no claims cited

Description¶

For evaluation research, the guide advises that "When reporting evaluation research results, provide adequate details about implementation and context about where the study took place so other schools can determine whether the product is a good fit". Details may include demographics, student-teacher ratio, user training, Internet/wifi access, and compatibility with existing technology infrastructure and data systems. It also urges developers to demonstrate that internal learning gains map onto "other commonly used measures in schools" such as standardized tests, course completion, and mastery of learning.

Design Implications¶

Context¶

Requirements¶

• Data collection strategies supporting the chosen evaluation method should be planned early in product development

Constraints¶

• Internal product measures alone are insufficient; gains must be shown to map onto external measures valued in education

Target Learners¶

• ed tech product developers
• school and district decision makers

Target Learning Goals¶

• demonstrating and communicating product effectiveness in educational settings

Affordances¶

• Three Research Types Edtech Product Development

Related Strategies¶

• Link implementation and impact findings when analyzing and reporting impact studies

Examples¶

-

Key Sources¶

• Digital Promise. (2015). Using Research in Ed Tech: The what, how, and why of research-based product development. https://digitalpromise.dspacedirect.org/items/f25f7b43-06d9-4732-908b-7409f79b0a91