In Mnemosyne log data, exponential forgetting curve models that include a delay term perform comparably to 1PL-IRT, the best-performing benchmark model.¶

Claim · All claims
Evidence · 1 study · causal r? · q2
Currency · newest study 2016 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2019: tool and model accuracy changes quickly

Subclaims¶

q2 i? Exponential forgetting models 5, 8, 10 and 13, which include the delay term, performed comparably to 1PL-IRT (model 3), the best benchmark among 0PL-IRT, 1PL-IRT and logistic regression; comparable performance was read from AUC curves and equivalence was not tested. → Reddy 2016

Evidence¶

Reddy 2016¶

Reddy, S., Labutov, I., Banerjee, S., & Joachims, T. (2016). Unbounded Human Learning: Optimal Scheduling for Spaced Repetition. KDD ’16, San Francisco, CA, USA. https://doi.org/10.1145/2939672.2939850

q2 · i? · causal · r?

Observational study of Mnemosyne flashcard log data, comparing memory models by cross-validated validation AUC against benchmark models. Models including the delay term "perform comparably to 1PL-IRT (model 3), which is the best-performing benchmark model"; no AUC values are printed.

"Exponential for- getting models that include the delay term (models 5, 8, 10, and 13) perform comparably to 1PL-IRT (model 3), which is the best-performing benchmark model"

Discussion¶

Related Claims¶

• The survey reports, citing Pavlik et al., that no single knowledge tracing model was always the best, and that a better model must consider multiple student features and the learning context. — the general claim this finding bears on, with the studies behind it

• Memory-decay-based models fit fact-learning datasets better than models insensitive to memory decay — the general claim this finding bears on, with the studies behind it

• In Mnemosyne flashcard log data, adding a delay term improves the recall-prediction performance of exponential forgetting curve memory models. — related
• In Mnemosyne log data, item-specific difficulty parameters outperform a global difficulty for lower and higher Leitner decks, while global difficulty performs better for intermediate decks. — related
• In Mnemosyne log data, setting memory strength equal to an item's Leitner deck position predicts recall better than number of past reviews, which beats constant strength. — related