A 2026 text-mining review chapter reports that studies of ChatGPT in programming education find benefits where it is used with structured pedagogical guidance and teacher facilitation¶

Claim · All claims
Evidence · 1 study (2 entries) · review r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Studies reviewed in the chapter report that structured ChatGPT interventions improved student performance, critical thinking, debugging, motivation, self-efficacy, and coding accuracy. → Grume 2026 q2 i? ChatGPT-4 automated grading correlated 0.91 with instructor scores while completing evaluations faster than manual grading. → Grume 2026 (2)

Evidence¶

Grume 2026¶

Grume, J. C., Miranda, J. P. P., De Leon, A. P., Salenga, J. L., Hernandez, H. E., Castro, M. A., Maniago, V. G. M., Canlas, J. D., & Quiambao, J. B. (2026). Pedagogical Promise and Peril of AI: A Text Mining Analysis of ChatGPT Research Discussions in Programming Education. In M. B. Garcia (Ed.), Pedagogical Innovations in Computer Science Education (pp. 305-330). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-6546-6.ch010

q2 · i? · review · r2

Narrative synthesis of reviewed intervention studies including the R5E model (higher post-test gains in computational thinking), PyChatAI bilingual feedback, a mobile learning system, and a GPT-based code review system. The chapter concludes ChatGPT "contributes to programming education when supported by pedagogical guidance and teacher facilitation."

"These studies show that ChatGPT contributes to programming education when supported by pedagogical guidance and teacher facilitation."

Grume 2026 (2)¶

Grume, J. C., Miranda, J. P. P., De Leon, A. P., Salenga, J. L., Hernandez, H. E., Castro, M. A., Maniago, V. G. M., Canlas, J. D., & Quiambao, J. B. (2026). Pedagogical Promise and Peril of AI: A Text Mining Analysis of ChatGPT Research Discussions in Programming Education. In M. B. Garcia (Ed.), Pedagogical Innovations in Computer Science Education (pp. 305-330). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-6546-6.ch010

q2 · i? · review · r2

The chapter reports, citing Bernik et al. (2025), a comparative study of large language models in programming assignment grading, in which "ChatGPT-4 graded programming submissions with a 0.91 correlation to instructor scores." No effect size is printed for the speed advantage.

"Bernik et al. (2025) demonstrated that ChatGPT-4 graded programming submissions with a 0.91 correlation to instructor scores while completing evaluations faster than manual grading."

Discussion¶

Related Claims¶

• AI-supported instruction has a moderate positive effect on student achievement in STEM education (g = 0.670 under a random effects model) — the general claim this finding bears on, with the studies behind it
• Unstructured ChatGPT use in programming education is linked to overreliance, reduced persistence, unreliable outputs, and academic integrity risks — reports the opposite
• Reviewed studies consistently raise concerns about AI accuracy, overreliance, academic integrity, and reduced critical engagement in Arab EL2 contexts — related
• Overreliance on AWE may lower learners' critical thinking and creativity — related
• Reviewed literature reports risks of overreliance, AI errors in complex tasks, and students' uncritical acceptance of AI-generated outputs — related
• A systematic review of 14 studies (8,305 participants) found AI-based tools enhanced comprehension, engagement, problem-solving, and critical thinking by personalizing learning experiences — a broader claim this one bears on
• Students' main AI challenges are content reliability and depth, and most expect AI to serve as tutor, creative partner, and critical thinking partner rather than mere content generator — related
• Teachers find ChatGPT a creative, fast, iterative brainstorming partner that adds specific numbers and details when posing math questions from photos — related
• Adult learners emphasize human-in-the-loop AI design that keeps final learning decisions with learners and instructors — related
• AI-assisted practice applications improved music students' performance outcomes, self-efficacy, and self-regulated learning — related
• Across studies, ChatGPT serves as a convenient tool assisting teachers, students and researchers in various tasks, with the consistent underlying motivation of seeking personal benefits and reducing academic burdens. — related
• Drawing support that facilitates integration significantly increases comprehension, while support not expected to facilitate integration does not — related