A multi-skill prior strategy yielded lower prediction error in 33 of 42 problem sets¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2010 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2013: tool and model accuracy changes quickly

Subclaims¶

q2 i? Of three strategies for setting individualized initial knowledge parameters, the strategy that uses information from multiple skills to inform each student's prior performed best, achieving lower prediction error in 33 of 42 problem sets. → Pardos 2010

Evidence¶

Pardos 2010¶

Pardos, Z.A., Heffernan, N.T. (2010). Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing. UMAP 2010, Lecture Notes in Computer Science, vol 6075. Springer. https://doi.org/10.1007/978-3-642-13470-8_24

q2 · i? · design · r2

The authors compared three strategies for setting initial individualized knowledge parameters on real-world data. They report "the best strategy is one in which information from multiple skills is used to inform each student's prior," with lower prediction error in 33 of 42 problem sets evaluated.

"We explore three difference strategies for setting the initial individualized knowledge parameters and report that the best strategy is one in which information from multiple skills is used to inform each student's prior."

Discussion¶

Related Claims¶

• Individualizing the initial knowledge parameter reliably improves prediction of real-world data — related
• Training dAFM with individualized student ability estimates yields essentially no prediction benefit over average ability — related
• The survey reports, citing Pavlik et al., that no single knowledge tracing model was always the best, and that a better model must consider multiple student features and the learning context. — related
• Standard knowledge tracing models in use do not allow individual learning rates or individualized initial knowledge — related