Reflection produced selective rather than blanket rejection of AI: alignment with correct advice stayed high while alignment with incorrect advice dropped¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

q3 i? Both AI-assisted groups frequently aligned with correct ChatGPT recommendations, but the reflection group showed a consistent downward shift in following incorrect recommendations across all task domains. → Ren S 2026

Evidence¶

Ren S 2026¶

Ren S (2026) College students’ metacognitive awareness of generative-AI reliance: an experimental study of decision confidence and attribution bias. Front. Psychol. 17:1926110. https://doi.org/10.3389/fpsyg.2026.1926110

q3 · i? · causal · r2

Figure 2 analysis of AI-consistent final responses by advice correctness and task category: "reflection markedly reduced alignment with incorrect advice" while both groups showed similar high alignment with correct advice. Descriptive pattern; no test statistic is printed for this contrast.

"This pattern strengthens the interpretation that reflection improved discriminative reliance–students remained able to use helpful AI advice while becoming less vulnerable to plausible but incorrect ChatGPTrecommendations."

Discussion¶

Related Claims¶

• Reflection improves correspondence between perceived and behavioral reliance on ChatGPT — the general claim this finding bears on, with the studies behind it

• Evidence suggests over-reliance on generative AI may negatively affect students' self-regulated learning behaviors, potentially harming retention and transfer to novel contexts — the general claim this finding bears on, with the studies behind it

• Better awareness calibration co-occurs with lower incorrect-advice acceptance and lower attribution bias, interpreted associationally only — related
• Open ChatGPT support increases college students' final decision confidence relative to independent decision-making, and reflection attenuates the boost — related
• A brief metacognitive reflection prompt reduces acceptance of incorrect AI advice compared with open ChatGPT support alone — related
• ChatGPT recommendation accuracy was comparable between the open-support and reflection conditions, ruling out unequal exposure to erroneous advice — related
• AI assistance can inflate confidence even after errors and reduce accuracy when AI is faulty (cognitive surrender) — a broader claim this one bears on
• Reviewed literature reports risks of overreliance, AI errors in complex tasks, and students' uncritical acceptance of AI-generated outputs — a broader claim this one bears on
• Students frequently accepted misleading AI recommendations (overreliance) while rarely rejecting correct ones (underreliance) — related
• Trust and reliance can diverge, and self-reported reliance measures cannot classify calibration without output-quality ground truth — related
• Similarity between AI and peer feedback reassured students and increased their confidence in peer response — related