Meta-reviews reach contradictory conclusions on whether AI reliance harms or helps critical thinking, with substantial design limitations limiting generalizability¶

Claim · All claims
Evidence · 1 study · review r? · q2
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

q2 i? Substantial limitations in study designs, including small sample sizes and short study durations, limit the generalizability of results on AI and critical thinking. → Inie 2026

Evidence¶

Inie 2026¶

Inie, N., Kristensen, A. M., Misfeldt, M., & Dalsgaard, P. (2026). A Critical Review of Critical Thinking in HCI Research About AI. International Journal of Human–Computer Interaction. https://doi.org/10.1080/10447318.2026.2722522

q2 · i? · review · r?

The review reports, citing Premkumar et al. (2024), that "small sample sizes, short study durations, and specific disciplinary focus" limit the generalizability of results in this literature.

"Substantial limitations in study designs, such as small sample sizes, short study durations, and specific disciplinary focus, however, limit the generalizability of results (Premkumar et al., 2024)."

Studies bearing on this claim¶

Does using generative AI help or harm learners' critical thinking, and what decides which? This table gathers the studies behind this claim and the 17 narrower claims that bear on it: 17 distinct studies (5 review, 4 associational, 3 design, 2 quant-synthesis, 2 causal, 1 theoretical), q2–q3, 7 of 17 with an effect size coded. One row per study, codes as each entry records them; no effect is averaged and no verdict is drawn. Built by scripts/synthesize_claim.py from eval/synthesis/; a row that looks wrong is fixed on the claim it comes from.

Discussion¶

Related Claims¶

• AI tools can enhance short-term task performance while undermining durable learning (the learning-performance paradox) — related
• Reviewed literature reports risks of overreliance, AI errors in complex tasks, and students' uncritical acceptance of AI-generated outputs — related
• 80% of IB student essays explicitly link reliance on AI to reduced thinking — related
• The authors of one course-based design study conclude, without printed measures, that structured AI integration can enhance students' digital literacy, content retention and critical thinking — related
• Prior meta-analytic evidence indicates chatbot technology has a substantial positive effect on overall learning outcomes and knowledge retention, but not on critical thinking, engagement, or motivation — related
• A three-month WISE Agent intervention did not significantly increase sixth-graders' aggregate critical thinking disposition scores — a narrower finding that bears on this claim
• Over-reliance on AI dialogue systems reduces students' critical and analytical thinking skills, especially when they become overly dependent on AI-generated content — reports the opposite
• AI-based educational technology use is positively associated with critical thinking among undergraduate medical students — reports the opposite
• GPT feedback in VR markedly improved problem-solving and critical thinking but had limited impact on creativity — reports the opposite
• Unscaffolded GenAI access was not associated with a significant difference in pre-service teachers' critical thinking relative to traditional learning — related
• LLM responses that are incomplete or incorrect prompt students to question, verify and improve the information, fostering critical thinking through cycles of validation and correction — related
• Meta-analytic evidence on GenAI and critical thinking shows a positive mean association with a prediction interval spanning harm to benefit — related