LearnMate2 improved learning outcomes and user experience compared to a baseline combining an online learning platform and an LLM in a user study (n=16)¶

Claim · All claims
Evidence · 1 study · causal r? · q3
Currency · no dated study recorded · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

q3 i? In a user study with 16 participants, LearnMate2 improved both learning outcomes and user experience compared to a workflow combining a state-of-the-art online learning platform and an LLM for learning support. → final-study

Evidence¶

final-study¶

Xinyu Jessica Wang, Christine P Lee, and Bilge Mutlu. 2026. LearnMate2: Design and Evaluation of an LLM-powered Personalized and Adaptive Support System for Online Learning. In Designing Interactive Systems Conference (DIS '26), June 13–17, 2026, Singapore, Singapore. ACM, New York, NY, USA. https://doi.org/10.1145/3800645.3812972

q3 · i? · causal · r?

The authors conducted a final user study (n=16) comparing LearnMate2 against a workflow combining a state-of-the-art online learning platform and an LLM used for learning support. They report that "LearnMate2 advances AI pedagogy by improving both learning outcomes and user experience compared to existing online learning and support tools."

"Results indicate that LearnMate2 advances AI pedagogy by improving both learning outcomes and user experience compared to existing online learning and support tools."

Discussion¶

Related Claims¶

• In a preliminary 2×3 controlled lesson study across five backbone LLMs, structured student agents produce more differentiated mastery and misconception traces than a baseline simulator — related
• The bespoke GenAI workflow operated as a modest equalising mechanism, with students reporting inclusive participation regardless of prior AI or drawing experience — related
• Participants valued multimodal experiences combining visualization with hands-on interaction, while reporting challenges with complex or unclear visualizations — related
• In a 24-participant three-modality user study, learners' workflows and engagement with fundamental mechanics problems varied across instructional modalities — related
• Persistence and performance costs concentrate among participants who used the AI to obtain direct solutions, while hint-users resemble controls — related
• ChatGPT users showed a non-significant trend toward worse overall informal learning outcomes than Google Search users over 8 days — related
• The authors argue AI web agents have the potential to accelerate advancements in online learning by giving fast, low-cost insights — a broader claim this one bears on