Product-outcome studies report GenAI-related gains on product-quality measures but do not assess durable, transferable learning¶

Claim · All claims
Evidence · 1 study · theoretical r3 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The review reports that AI-assisted students achieved higher academic scores than peers using traditional resources, and a meta-analysis of 56 experimental studies reported a moderate positive short-term effect on creative thinking (SMD = 0.54), but these outcome measures capture product quality rather than durable transfer. → Lin J and Al-Hada NM 2026

Evidence¶

Lin J and Al-Hada NM 2026¶

Lin J and Al-Hada NM (2026) The critical-thinking paradox in generative AI-integrated learning: distinguishing efficiency from cognitive depth—a differentiated framework and testable propositions. Front. Psychol. 17:1906070. https://doi.org/10.3389/fpsyg.2026.1906070

q2 · i? · theoretical · r3

Narrative review attribution: the article reports, citing Mariñoso et al. (2025), that "AI-assisted students can achieve higher academic scores than peers using traditional resources". It notes these studies' primary outcomes capture product quality—grades, attitudes, well-being—and do not answer whether AI helps students build durable, transferable knowledge.

"quasi-experimental evidence indicates that AI-assisted students can achieve higher academic scores than peers using traditional resources"

Discussion¶

Related Claims¶

• As cited second-hand in an AI-literacy framework paper: ChatGPT use improved short-term essay scores but triggered metacognitive laziness with no significant knowledge-transfer gains — related
• genAI-supported work can improve while the constructive processing underlying durable expertise erodes (the performance–metacognition dilemma) — a broader claim this one bears on
• Falsifiable hypothesis: unrestricted AI use on deep-processing tasks will produce a product–process dissociation—higher-rated assignments but lower unaided delayed transfer — related
• The decisive empirical test of AI-augmented instruction frameworks is whether students retain representational competence when AI support is withdrawn — related
• Learning outcomes differ by how students use AI: augmentation and mixed users show gains in both sessions, while automation users' Session One essay advantage is absent from their unaided essays — related
• The GenAI session strengthened immediate AI-handling confidence and workflow literacy, but students remained hesitant about transferring these skills to employment — related
• GenAI systems achieved consistently high scores on programming assessments written entirely in Estonian — related
• A meta-analysis of 69 studies reports generative AI improves academic performance with g = 0.7, but the article argues this likely reflects immediate task success rather than learning — a narrower finding that bears on this claim
• ChatGPT's intuitive interface and instant feedback can either support learning or enable superficial task completion depending on integration — related
• FRAC and combined intervention advantages transferred to a new writing task and were retained after AI support was withdrawn — related
• Evidence on GenAI in chemistry education is concentrated in short-term outcomes, with durable transfer and retention rarely tested — a broader claim this one bears on
• Agentivism generates six empirically testable propositions linking delegation structure, verification, reconstruction, and reduced-support transfer to learning outcomes — related
• AI-assisted task performance can rise without corresponding gains in underlying knowledge, metacognitive processing, or independent reasoning — a narrower finding that bears on this claim
• GenAI use in creative contexts tends toward regression to the mean: less skilled users improve while higher skilled users decline — related
• Proposition 1: outcome-aligned ownership performances will predict later individual transfer beyond AI-assisted product quality alone — related
• When AI assistance is withdrawn, student performance tends to decline, revealing a lack of internalized learning strategies — related