Engagement forecasting as a supervised week-ahead prediction task in ITS

Research Method · All research methods
Evidence · 4 claims (2 for, 2 mixed) · 1 study (1 associational), q2 · 0 of 1 report an effect size · 4 claims rest on one study

Description

Engagement forecasting is framed as a supervised prediction task estimating a learner's next-week engagement from prior ITS interaction traces. The article defines it as "a supervised, week-ahead regression task within an ITS predicting two observable outcomes: minutes practiced (effort) and new skills mastered (progress)". It complements fine-grained EDM tasks (affect detection, wheel-spinning, dropout prediction) by operating at a weekly timescale aligned with instructional rhythms, and its explainability analysis positions forecasts as decision-support signals for tutors and students rather than direct measures of motivation or learning.

Accounts

• Engagement forecasting as a supervised week-ahead prediction task in ITS: Engagement forecasting is framed as a supervised prediction task estimating a learner's next-week engagement from prior ITS interaction traces. The article defines it as "a supervised, week-ahead regression task within an ITS predicting two observable outcomes: minutes practiced (effort) and new skills mastered (progress)". It complements fine-grained EDM tasks (affect detection, wheel-spinning, dropout prediction) by operating at a weekly timescale aligned with instructional rhythms, and its explainability analysis positions forecasts as decision-support signals for tutors and students rather than direct measures of motivation or learning. (Eric S. Qiu et al. (2026))

Claims

• Feature-based ML models reduce next-week forecasting MAE by 22-33% over heuristic baselines for weekly minutes practiced and new skills mastered [+M]
• Effort forecasting is driven by recent engagement activity while progress forecasting depends more on learner-centered signals such as ability, difficulty, and consistency [+M]
• Percentile heuristics transferred from health behavior systematically overpredict weekly K-12 engagement and underperform XGBoost by 20-30% [~W]
• Ablations show every feature group contributes to skills forecasting, while recent engagement activity alone nearly suffices for minutes [~W]

Related Research Methods

-

Key Sources

• Eric S. Qiu, Danielle R. Thomas, Boyuan Guo, Vincent Aleven, Conrad Borchers. (2026). From Heuristics to Analytics: Forecasting Effort and Progress in Online Learning. https://arxiv.org/abs/2605.12788

Page metadata

Field	Value
type	research-method
id	engagement-forecasting-as-a-supervised-week-ahead-prediction-task-in-its
title	Engagement forecasting as a supervised week-ahead prediction task in ITS
description	Engagement forecasting is framed as a supervised prediction task estimating a learner's next-week engagement from prior ITS interaction traces.
status	review
generated	by process:settle-candidates on 2026-10-10
trust	unverified — no one has confirmed this page's content

Frontmatter is the page's machine-readable record — see the Schema & Guide.