ChatGPT biased information access toward solution-oriented artifacts over principle-oriented information¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r1 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q2 i? ChatGPT participants extracted principle-oriented information in 66.33% of entries versus 97.14% for Google, and extracted artifacts (meal plans, grocery lists) in 46.94% versus 6.43%. → Shravika Mittal 2026 q2 i? Even principle-oriented queries to ChatGPT returned sample meal plans and grocery lists, leading one participant to plan to rely on ChatGPT for future meal planning. → Shravika Mittal 2026 (2)

Evidence¶

Shravika Mittal 2026¶

Shravika Mittal, Su Lin Blodgett, Q. Vera Liao. (2026). Learning by Chatting? Investigating the Impact of Generative AI on Information Seeking and Learning. https://arxiv.org/abs/2606.11669 doi:10.48550/arxiv.2606.11669

q2 · i? · causal · r1

Thematic analysis of diary entries coded for extracting principle-oriented information. Artifact extraction was observed in 46.94% (nC=46/98) of ChatGPT entries versus 6.43% (nG=9/140) of Google entries, per the same Table 1 analysis.

"66.33%(n C=65/98) entries from ChatGPT participants described this behavior, compared to97.14%(n G=136/140) of entries from participants in the Google group."

Shravika Mittal 2026 (2)¶

Shravika Mittal, Su Lin Blodgett, Q. Vera Liao. (2026). Learning by Chatting? Investigating the Impact of Generative AI on Information Seeking and Learning. https://arxiv.org/abs/2606.11669

q2 · i? · causal · r1

Diary excerpt from ChatGPT participant P11 illustrating that even a principle-oriented query yielded a meal plan and grocery list; the same participant stated plans to keep using ChatGPT to create meal plans after the study.

""I asked ChatGPT how much of each macronutrient one should have for a balanced meal. It gave me a balanced meal plan. [...] It asked if I'd want a grocery list, which it provided.""

Discussion¶

Related Claims¶

• ChatGPT users differentiated information less (never by credibility) and rarely verified information compared to Google users — related
• ChatGPT users showed a non-significant trend toward worse overall informal learning outcomes than Google Search users over 8 days — related
• ChatGPT users began information seeking with narrow, specified queries far more often than Google users — related
• ChatGPT participants experienced meta-cognitive load and frictions, with slightly more unsatisfied endings than Google participants — related
• Reviewed literature reports risks of overreliance, AI errors in complex tasks, and students' uncritical acceptance of AI-generated outputs — a broader claim this one bears on
• Google Trends data show ChatGPT search interest surged globally within weeks of its November 2022 public release, with plagiarism among the top related queries — related
• ChatGPT users were significantly less likely to correctly compare and evaluate animal and plant protein sources — related
• Learning-oriented intentions did not significantly predict enacted in-chat behavior; only selecting final solutions predicted executive and answer-seeking requests — related
• Students using ChatGPT 3.5 experience lower germane cognitive load than students using Google, the strongest of the three load differences — related
• Students using Google produce higher-quality justifications in their final recommendations than students using ChatGPT 3.5 — related