Post-test mathematics performance was significantly lower than pre-test after AI-tutor use¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? A paired Wilcoxon test showed a significant decrease from pre-test (67.5%) to post-test (56.9%, p=.014). → Rania Abdelghani 2026

Evidence¶

Rania Abdelghani 2026¶

Rania Abdelghani, Peter Kaiser, and Kou Murayama. (2026). Regulating the AI Tutor: Intentions, Help-Seeking, and Self-Regulated Learning in Adolescent GenAI Use. Accepted at the NextGen Learning Interfaces Workshop, AIED 2026. https://arxiv.org/abs/2606.08568 doi:10.48550/arxiv.2606.08568

q2 · i? · associational · r2

Within-student comparison of pre- and post-test mathematical modeling scores in the single-session classroom study (n=98 analyzed sample per the study design). Only the test statistic and means are printed; no effect size is reported, so equivalence was not tested.

"A paired Wilcoxon test showed a significant decrease from pre- (67.5%) to post- test (56.9%,p=.014)"

Discussion¶

Related Claims¶

• Students show large immediate pre-to-post knowledge gains within a single LLM-supported learning session — related
• A 60-minute session with Prompt Coach significantly improved professional developers' prompt quality, a 13.73% relative gain overall — related
• AI multimodal feedback produces post-test learning gains equivalent to educator feedback after controlling for pre-test performance — related