The main concern in all critical evaluations was the veracity of ChatGPT-provided references, which often do not exist¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2025 · checked against its sources 2026-10-27 (automated, 1 of 1 entry) · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Participants' critical evaluations identified fabricated-looking references as ChatGPT's main weakness. → Angela Oates · Donna Johnson 2025
Evidence¶
Angela Oates · Donna Johnson 2025¶
Angela Oates · Donna Johnson. (2025). ChatGPT in the Classroom: Evaluating its Role in Fostering Critical Evaluation Skills. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-024-00452-8
q2 · i? · design · r2
Findings from the authors' reading of participants' critical evaluations in the Results section. "The main concern raised in all the critical evaluations" was reference veracity, and closer examination often revealed citations that "do not exist".
"The main concern raised in all the critical evaluations pertained to the veracity of the references provided by the AI software. ChatGPT can generate citations that appear accurate, attributing to authors actively publishing in relevant areas, however, closer examination often reveals that the suggested publications and citations do not exist."
Discussion¶
Related Claims¶
- The most frequently cited ethical concerns about GenAI in research were hallucinated facts, fabricated references, and misleading content — a broader claim this one bears on
- Institutional guidance cautions instructors about privacy (60% of institutions) while syllabi more often flag veracity of GenAI output and hindering learning — related
- Students' top two concerns about educational LLM use are output quality (fabricated or misleading content, 53 mentions) and the verification burden (34 mentions) — related
- Students report negative experiences with ChatGPT including inaccurate outputs, lack of emotional connection, and risk of overreliance, which constrain competence — related
- ChatGPT fabricates references: the authors caught it inventing a non-existent 'Ribeiro and Vala, 2020' article with full bibliographic details — a narrower finding that bears on this claim
- Gen-AI hallucinates sources and values and produces convincing but incorrect explanations, risking student misinformation — related
- Scholars raise three main concerns about AI chatbots in education: reliability and accuracy, fair assessment, and ethical issues — related
- Poorly grounded GenAI self-study risks fabricated content and inferior learning relative to curated resources — related
- GPT-3 fabricates plausible-looking but fake references and apparently invents the research studies they cite — related
- Pessimistic Evaluators' foremost concern is misleading, inaccurate, or biased ChatGPT-generated information — related
- Students broadly endorse LLMs as educational aids (74% positive) while 61% raise integrity concerns, 59% cite hallucination risk, and 82% report no institutional guidance — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-27 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.