Grow a peer review community that understands the affordances and limits of DLP-based research¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The paper argues that research conducted on DLPs can be misjudged by reviewers from other traditions, because few reviewers have done such work: reviewers "may not appreciate the cleverness with which the researcher fit their study question into the DLP's limitations." The authors conclude that "the success of the movement to use DLPs as research infrastructure will likely require building a peer review community with awareness of the expectations, background requirements, limits, and assumptions of this kind of research." DLP research resembles secondary data analysis and survey-platform hosting, yet differs because data can be captured for the project and curricular content can be modified.

Design Implications¶

Context¶

Requirements¶

• Education of reviewers about how DLP research differs from traditional controlled experiments, and sharing of network resources to reduce intimidation for new researchers

Constraints¶

• The examples given are hypothetical illustrations; the authors do not report evaluated instances of reviewer misjudgment

Target Learners¶

• research proposal reviewers and funders of educational research

Target Learning Goals¶

• fair evaluation of studies conducted on digital learning platforms

Related Strategies¶

Examples¶

-

Key Sources¶

• Roschelle, J., Wortman, A., & Pautz Stephenson, S. (2025, January). Expected and Emerging Requirements for Digital Learning Platforms as Research Infrastructure. Digital Promise. https://doi.org/10.51388/20.500.12265/241