Teachers report ChatGPT-generated math questions misalign with grade level and topic, are unreliable or unanswerable, and cost time¶

Claim · All claims
Evidence · 1 study · qualitative r2 · q2
Currency · newest study 2025 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q2 i? Teachers' concerns about ChatGPT as a brainstorming partner included grade-level misalignment, math topic misalignment, prompt sensitivity, unreliability/hallucinations, and time cost. → Candace Walkington and Katie Bainbridge 2025

Evidence¶

Candace Walkington and Katie Bainbridge 2025¶

Candace Walkington and Katie Bainbridge. (2025). Mathematics Teachers' Use of Generative AI to Create Active Learning Experiences. https://socialinnovationsjournal.com/index.php/sij/article/view/9994

q2 · i? · qualitative · r2

Reflexive thematic analysis of the written feedback from the 11 teachers in a university Algebraic Reasoning course, who had ChatGPT pose mathematics questions from photos of their surroundings and then reflected on it as a brainstorming partner (Table 4 themes); teachers also cited hallucinations, noting "GPT could be wrong. Human[s] need to justify whether their answer is right or wrong."

"“It doesn’t have a good grasp of what mathematical concepts are appropriate for a specific grade level. I asked it for Algebra 2-level math questions, and it gave me a lot of geometry-related questions.”"

Discussion¶

Related Claims¶

• Teachers find ChatGPT a creative, fast, iterative brainstorming partner that adds specific numbers and details when posing math questions from photos — related
• Teachers find Ecree's feedback less useful when it does not align with their typical content sequence and grading standards — related
• Teachers raise big-picture concerns about GenAI including surveillance, over-reliance, reduced teacher collaboration, job replacement, and training needs — related
• Mathematics teachers critique ChatGPT-generated generative learning lessons for poor fit to students, boredom, preparation time, missing student-facing materials, mathematical flaws, and required materials — related
• Students' main AI challenges are content reliability and depth, and most expect AI to serve as tutor, creative partner, and critical thinking partner rather than mere content generator — related
• ChatGPT shows high success on open-ended general chemistry exam questions but lower accuracy at the university level, and unverified copying of its answers is a reported risk — related
• Assessment shifts from the quality of AI-generated text to articulating tasks, justifying prompt choices, and reflexively evaluating AI behaviour — related
• The primary learning challenge shifts from navigating networks to evaluating and integrating AI-generated output whose sources are not visible — related
• Teachers actively use AI tools but face challenges with content accuracy and usage guidelines — a broader claim this one bears on
• General-purpose LLMs show accuracy and reliability limits, including hallucinations and task-specific accuracy below perfect, making them risky as expert advice sources — related
• Teachers treated AI as a provisional thinking partner whose outputs required iterative adaptation rather than automatic adoption — related
• Formative assessment practices coherent with OpenSciEd are constrained by grading expectations misaligned with formative goals and by the time cost of evaluating and giving feedback on three-dimensional tasks. — related
• ChatGPT sustains coherent, human-like multi-topic conversation and produces convincing creative content, as shown by the authors' own prompting test — reports the opposite