ChatGPT users were significantly less likely to correctly compare and evaluate animal and plant protein sources¶
Claim · All claims
Evidence · 1 study · causalr1·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? A significantly smaller proportion of ChatGPT participants answered Q7 (comparing and evaluating animal and plant protein sources) correctly compared to Google participants (21% vs. 57%). → Shravika Mittal 2026
Evidence¶
Shravika Mittal 2026¶
Shravika Mittal, Su Lin Blodgett, Q. Vera Liao. (2026). Learning by Chatting? Investigating the Impact of Generative AI on Information Seeking and Learning. https://arxiv.org/abs/2606.11669 doi:10.48550/arxiv.2606.11669
q2 · i? · causal · r1
Fisher's exact test on Q7 correctness in the field experiment. The article attributes the gap to content bias: diary entries reported that "ChatGPT by default provided meat-based sources of protein," with one participant noting it "automatically assumes that everyone eats meat."
"Again, a significantly smaller proportion of participants in the ChatGPT condition answered correctly compared to those in the Google condition (21%vs.57%; odds ratio:0.21; Fisher'sp:0.04)."
Discussion¶
Learner Variables¶
- Critical Thinking — outcome: instruction changes it
Related Claims¶
- ChatGPT users differentiated information less (never by credibility) and rarely verified information compared to Google users — related
- ChatGPT users showed a non-significant trend toward worse overall informal learning outcomes than Google Search users over 8 days — related
- ChatGPT users were significantly less likely to correctly answer a critical-learning question requiring interpretation of a nutrition label — related
- ChatGPT users began information seeking with narrow, specified queries far more often than Google users — related
- ChatGPT participants experienced meta-cognitive load and frictions, with slightly more unsatisfied endings than Google participants — related
- Conversational synthesis can hide source plurality behind one voice, weakening verification relative to search — related
- ChatGPT biased information access toward solution-oriented artifacts over principle-oriented information — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
chatgpt-worse-protein-comparison-question |
title |
ChatGPT users were significantly less likely to correctly compare and evaluate animal and plant protein sources |
description |
ChatGPT users were significantly less likely to correctly compare and evaluate animal and plant protein sources |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — shravika-mittal-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.