Use a 2x2 factorial design to separate the effects of contextual relevance and linguistic detail in word problems¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The article proposes that contextually relevant language may be more engaging, but adding context often adds linguistic detail that may reduce clarity, making the two influences "possibly separable." It therefore recommends a factorial experiment with two factors, each with two levels: "context (low/high) and detail (low/high)," yielding four conditions. This lets researchers estimate the effects of engagement-enhancing context and clarity-reducing detail separately, including their interaction.

Design Implications¶

Context¶

Requirements¶

• Four versions of each question set corresponding to the four conditions must be created from the current curriculum's practice sets

Constraints¶

• The design as illustrated is within-subjects, with students switching conditions across units

Target Learners¶

• K-12 math students completing weekly practice question sets

Target Learning Goals¶

• disentangling engagement and clarity effects of word-problem language on math learning

Related Strategies¶

• Leverage digital learning platforms to run unobtrusive randomized experiments on language modifications in math problems

Examples¶

-

Key Sources¶

• Wei, X., Wortman, A., Cheng, L., Heffernan, N., Heffernan, C., Murphy, A., Zepeda, C., Motz, B., Jankowski, H., & Roschelle, J. (2024, March). Language and mathematics learning: A comparative study of digital learning platforms. Digital Promise. https://doi.org/10.51388/20.500.12265/206