Mathematical hallucinations were rare but teachers used professional knowledge to adjust mathematical properties¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? No instances of teachers identifying mathematical errors in final versions were seen, but teachers made 25 moves requesting mathematical clarification or vocabulary adjustment and critiqued number choice in 16 cases. → Walkington 2025
Evidence¶
Walkington 2025¶
Walkington, C., Beauchamp, T., Ikram, F., Koçyiğit Gürbüz, M., Xia, F., Lee, M., Lan, A. (2025). Mathematics Teachers’ Interactions with a Multi-Agent System for Personalized Problem Generation. https://arxiv.org/abs/2604.12066. doi:10.1007/978-3-032-29770-9_5
q2 · i? · design · r2
Analysis of teacher prompting moves found no identified mathematical errors in final problem versions, though teachers made 25 prompt moves requesting mathematical clarification or vocabulary adjustment and critiqued the LLM's number choice in 16 cases. Additionally, 18 student comments described lack of clarity of the mathematics.
"We did not see any instances of teachers identifying mathematical errors in the final version of the problem."
Discussion¶
Related Claims¶
- Realism issues were detected by agents during generation but were rare in final versions — related
- Teachers adjusted problem topics as the most common refinement move — related
- Reviewed literature reports risks of overreliance, AI errors in complex tasks, and students' uncritical acceptance of AI-generated outputs — a broader claim this one bears on
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
teachers-adjust-mathematical-properties-llm-problems |
title |
Mathematical hallucinations were rare but teachers used professional knowledge to adjust mathematical properties |
description |
Mathematical hallucinations were rare but teachers used professional knowledge to adjust mathematical properties |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2025 |
recheck_by |
2028 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — walkington-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.