Plan and design backwards from a research-based learning goal to features, metrics, and measurement tools¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The report recommends that product teams determine the desired learning outcomes first, then identify how to measure them and what tools to use, consulting existing research at each step. Read to Lead's process is described as "a kind of backwards-facing investigation, where the end result is determined first and the steps to get there are found in reverse." Dr. Brown's approach at EnGen similarly breaks the product idea into core components and digs into the literature about each.

Design Implications¶

Context¶

Requirements¶

• Access to learning sciences literature on the product's component topics
• Willingness to synthesize findings across fields to form hypotheses

Constraints¶

• The best or most fitting research may not exist for a given question; the report advises iterating rather than waiting for perfect evidence

Target Learners¶

• edtech product developers and their end users, including middle school students and adult English learners

Target Learning Goals¶

• articulated learning outcomes such as literacy, language acquisition, and mathematics

Related Strategies¶

• Understanding By Design Unit Template
• Distinguish learner research from user research and choose success metrics tied to educational outcomes rather than engagement
• Integrate educators and developers through regular cross-functional meetings so pedagogical intent survives technical implementation
• Use small-scale learning metrics during iteration and reserve proof metrics for later stages
• Five-step practical measurement process for improving CRSE mathematics instruction

Examples¶

-

Key Sources¶

• Van Nostrand, P., Noakes, S., Shah, Z., & Luke Luna C. (2022, February). An overlooked indicator of edtech quality: The use of learning sciences research. Digital Promise. https://doi.org/10.51388/20.500.12265/150