Over four months and four sessions, LLM-group participants performed worse than Brain-only participants at neural, linguistic, and scoring levels¶

Claim · All claims
Evidence · 1 study · causal r1 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Across the four sessions, LLM-group participants performed worse than Brain-only counterparts at all reported levels: neural, linguistic, and scoring. → Nataliya Kosmyna 2025

Evidence¶

Nataliya Kosmyna 2025¶

Nataliya Kosmyna, Eugene Hauptmann, Ye Tong Yuan, Jessica Situ, Xian-Hao Liao, Ashly Vivian Beresnitzky, Iris Braunstein, Pattie Maes. (2025). Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task. Preprint, under review. https://arxiv.org/abs/2506.08872 doi:10.48550/arxiv.2506.08872

q2 · i? · causal · r1

Longitudinal comparison across the four sessions conducted over four months with the same group assignments (54 participants in sessions 1-3, 18 completing session 4). The article states the LLM group "performed worse than their counterparts in the Brain-only group at all levels". No effect sizes are printed.

"the LLM group's participants performed worse than their counterparts in the Brain-only group at all levels: neural, linguistic, scoring."

Discussion¶

Related Claims¶

• Brain-to-LLM participants showed higher neural connectivity than the LLM group's sessions 1-3, with a network-wide spike in alpha, beta, theta, and delta band directed connectivity — a narrower finding that bears on this claim
• LLM-group participants reported low ownership of their essays and fell behind in their ability to quote from essays written minutes earlier — related
• In session 4, LLM-to-Brain participants showed weaker neural connectivity and under-engagement of alpha and beta networks, while Brain-to-LLM participants showed higher memory recall and re-engagement of occipito-parietal and prefrontal nodes — related
• Access to a generative-AI assistant raises task performance for both lower- and higher-education adults, with significantly larger gains for lower-education participants — reports the opposite
• AI-induced gains are not purely delegation: treated participants do not perform worse once AI is removed, and lower-education participants retain part of their gain, though a 0.200 SD gap re-emerges — reports the opposite
• Intensive LLM use in educational contexts may lead to an accumulation of cognitive debt that weakens critical thinking and epistemic ownership — a broader claim this one bears on
• Brain connectivity during essay writing systematically scales down with the amount of external support, with Brain-only strongest, Search Engine intermediate, and LLM weakest — related