Effort forecasting is driven by recent engagement activity while progress forecasting depends more on learner-centered signals such as ability, difficulty, and consistency¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q2 i? Minutes-practiced forecasts rely mainly on recent engagement activity features, whereas new-skills-mastered forecasts rely more on AFM-derived ability, difficulty, and consistency features. → Eric S. Qiu 2026

Evidence¶

Eric S. Qiu 2026¶

Eric S. Qiu, Danielle R. Thomas, Boyuan Guo, Vincent Aleven, Conrad Borchers. (2026). From Heuristics to Analytics: Forecasting Effort and Progress in Online Learning. https://arxiv.org/abs/2605.12788 doi:10.48550/arxiv.2605.12788

q2 · i? · associational · r2

Feature-importance rankings (Fig. 3) and category-level analysis across model families in the forecasting study; the article concludes "Effort(minutes practiced) is driven by recent engagement activity" while progress depends on learner-centered signals, with stronger cross-family rank stability for skills (category τ≈0.67).

"Effort(minutes practiced) is driven by recent engagement activity, while progress(new skills mastered) depends more strongly on learner-centered signals such as AFM-derived ability and difficulty, as well as consistency."

Discussion¶

Related Claims¶

• Ablations show every feature group contributes to skills forecasting, while recent engagement activity alone nearly suffices for minutes — related
• Feature-based ML models reduce next-week forecasting MAE by 22-33% over heuristic baselines for weekly minutes practiced and new skills mastered — related
• Tutors reason differently about effort versus progress goals in ways that mirror the target-specific feature patterns, and trust clearly defined feature-backed explanations — related
• Window 1 profiles complicate the assumption that greater pre-query effort signals better progress: Cold Start learners completed at 97% while Struggling learners completed at 67% — related
• Lay forecasters predicted that practicing alone would produce more learning than practicing with AI, contrary to the experimental results — related