Balance explanation-focused and prediction-focused methodological strategies in motivation research¶

Strategy · All strategies
Evidence · 2 claims (2 for) · 3 studies (2 theoretical, 1 associational), q1–q3 · 0 of 3 report an effect size · 1 claim rests on one study

Description¶

The essay observes that motivation theories focus almost exclusively on explanation while prediction is given short shrift. It explains that the model best approximating the data-generating process may not predict best due to overfitting, and that explanation-focused researchers fit models entirely in-sample whereas prediction-focused machine learning researchers evaluate on held-out data. It recommends integrating both strategies, citing Noetel et al. (2023) as showing how machine learning can redress the imbalance.

Design Implications¶

Context¶

Requirements¶

• Researchers must learn methodological approaches from both traditions, including held-out evaluation for prediction work

Constraints¶

• The essay notes it is uncertain whether psychological phenomena can be simplified enough to be modeled accurately, forcing a choice between complex accurate models and simple elegant ones

Target Learners¶

• quantitative motivation researchers
• machine-learning-oriented education researchers

Target Learning Goals¶

• building motivation models that both explain processes and predict outcomes

Claims¶

• Predictive modeling across four theories found critical teacher behaviors for engagement that did not fit within one theoretical model [+W]
• Fragmentation is caused by researchers themselves via misaligned incentives that favor staying in theoretical camps [+W]

Related Strategies¶

• Shift journal editorial and review practices to reward theoretically integrative work
• Evaluate motivational theories rigorously on predictive, practical, explanatory, and developmental value before integrating

Examples¶

-

Key Sources¶

• Ronnel B. King, Luke K. Fryer. (2024). Hybridizing Motivational Strains: How Integrative Models Are Crucial for Advancing Motivation Science. Educational Psychology Review. https://doi.org/10.1007/s10648-024-09850-9