Algorithm-selected learners remember content over ~69% longer, with median half-life increases of ~92% vs random and ~40% vs difficulty groups¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? The median decrease in median empirical forgetting rate for the 'select' group was ~48% vs 'random' and ~40% vs 'difficulty', with corresponding median half-life increases of ~92% and ~40%. → Utkarsh Upadhyay 2021

Evidence¶

Utkarsh Upadhyay 2021¶

Utkarsh Upadhyay, Graham Lancashire, Christoph Moser and Manuel Gomez-Rodriguez. (2021). Large-scale randomized experiments reveals that machine learning-based instruction helps people memorize more effectively. npj Science of Learning 6:26. https://doi.org/10.1038/s41539-021-00105-8

q3 · i? · causal · r2

Descriptive medians from the randomized controlled trial comparing the 'select' group against 'random' and 'difficulty' groups. The article reports "the corresponding median increase in the median half-lives was ~92% and ~40%"; no standardized effect size or significance test is printed for these medians.

"the median decrease in the median empirical forgetting rate for learners in the ‘select’ group was ~48% and ~40% when compared to learners in the ‘random’ and ‘difficulty’ groups, respectively, and the corresponding median increase in the median half-lives was ~92% and ~40%."

Discussion¶

Related Claims¶

• The selection algorithm affects engagement: select and difficulty groups were more likely to return within 4–7 days than the random group, but select-group learners were more likely to stop using the app in the initial 2 days — related
• ML-based question selection (SELECT) lowers learners' normalized empirical forgetting rate relative to difficulty-ordered and random selection after controlling for review time and number of reviews — possibly the same claim (merge candidate)
• Regression analysis shows the spacing effect holds in aggregate and the select group's advantage over other groups increases with number of reviews — related