Survey items on critical evaluation and validation of ChatGPT outputs (Q11–Q13) received the lowest scores in both courses despite explicit validation instructions¶

Claim · All claims
Evidence · 1 study · associational r1 · q2
Currency · newest study 2025 · checked against its sources 2026-10-19 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i? Items Q11, Q12, and Q13, addressing evaluation and validation of information provided by ChatGPT, received the lowest scores across both courses; for example Q12 scored 8.62 ± 2.20 in biology and 8.43 ± 2.31 in mathematics. → Elizondo-García ME 2025

Evidence¶

Elizondo-García ME 2025¶

Elizondo-García ME, Hernández-De la Cerda H, Benavides-García IG, Caratozzolo P and Membrillo-Hernández J (2025) Who is solving the challenge? The use of ChatGPT in mathematics and biology courses using challenge-based learning. Front. Educ. 10:1417642. https://doi.org/10.3389/feduc.2025.1417642

q2 · i? · associational · r1

Item-level survey analysis in the Results section. Although students were explicitly instructed to validate ChatGPT's outputs using formal sources (the biology activity required cross-checking with at least two academic sources), the critical-thinking items on independent judgment and skepticism "also scored lower," and the authors conclude the integration "did not strongly foster critical evaluation or validation skills."

"Q12, which asked whether the activity encouraged students to look for information from other sources, scored 8.62 ± 2.20 in “Fundamentals of Biological Systems” and 8.43 ± 2.31 in “Mathematics and Data Science for Decision Making”. These scores are notable, given that students were explicitly instructed to validate ChatGPT’s outputs using formal sources."

Discussion¶

Learner Variables¶

Critical Thinking — outcome: instruction changes it

Students rated ChatGPT highly for completing activities more quickly, among the highest-scoring survey items in both courses — related
Students' main AI challenges are content reliability and depth, and most expect AI to serve as tutor, creative partner, and critical thinking partner rather than mere content generator — related
Reviewed studies consistently raise concerns about AI accuracy, overreliance, academic integrity, and reduced critical engagement in Arab EL2 contexts — related
Students in the mathematics and data science course rated acceptance of the AI tool higher on average than students in the biology course — related
The primary learning challenge shifts from navigating networks to evaluating and integrating AI-generated output whose sources are not visible — related
ChatGPT feedback required doctoral students to validate the procedural accuracy of algorithm-generated outputs, with judgement shaped by prompt quality — reports the opposite
Critical thinking is rarely defined in HCI research about AI, with fundamental construct and criterion validity challenges — related
Preservice educators rate generative AI highest for logistical support (time saving, clarity, organizing thought) and lowest for epistemic trust, accuracy and consistency — a broader claim this one bears on

Page metadata

Field	Value
`type`	`claim`
`id`	`critical-evaluation-items-lowest-scores`
`title`	`Survey items on critical evaluation and validation of ChatGPT outputs (Q11–Q13) received the lowest scores in both courses despite explicit validation instructions`
`description`	`Survey items on critical evaluation and validation of ChatGPT outputs (Q11–Q13) received the lowest scores in both courses despite explicit validation instructions`
`status`	`review`
`evidence_strength`	`moderate`
`newest_evidence`	`2025`
`source_checked`	`2026-10-19`
`generated`	by `process:wiki-ingest` on `2026-10-10`
`trust`	unverified — no one has confirmed this page's content
`sources`	1 — `elizondo-garcía-me-2025`

Frontmatter is the page's machine-readable record — see the Schema & Guide.