Removing student major from the input marginally improves TRACE performance, suggesting major is recoverable from course history¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? A TRACE variant with major removed achieved MSE 0.0360 vs 0.0392 and MAE 0.1327 vs 0.1339, marginally better than the full model. → Paul Savala 2026
Evidence¶
Paul Savala 2026¶
Paul Savala. (2026). Jointly Predicting Courses and Grades Using a Transformer-Based Model. arXiv. https://arxiv.org/abs/2608.13409 doi:10.48550/arxiv.2608.13409
q2 · i? · design · r2
Feature-ablation analysis in which a TRACE variant was trained with student major removed from the input. The article reports "marginally improved performance" and interprets major as largely recoverable from early course selections, adding redundancy and overfitting risk.
"This ablation resulted in marginally improved performance (MSE: 0.0360 vs. 0.0392; MAE: 0.1327 vs. 0.1339), suggesting that major provides no additional predictive signal beyond course history and may introduce slight redundancy."
Discussion¶
Related Claims¶
- Jointly predicting courses and grades reduces grade-prediction MAE by 46.4% versus an identical Transformer that predicts grades only — related
- TRACE outperforms LSTM, GNN and XGBoost baselines on grade prediction — related
- KL-divergence and binary cross-entropy losses for course prediction yield grade prediction within 1-2% of each other — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
major-ablation-no-predictive-signal |
title |
Removing student major from the input marginally improves TRACE performance, suggesting major is recoverable from course history |
description |
Removing student major from the input marginally improves TRACE performance, suggesting major is recoverable from course history |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
recheck_by |
2029 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — paul-savala-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.