Student errors on underestimated fraction items reflect systematic misconception patterns rather than random error¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Error analysis shows empirical difficulty of the underestimated fraction items is driven primarily by conceptual misunderstandings such as "division makes smaller" beliefs and whole-number bias. → La Hadi 2025

Evidence¶

La Hadi 2025¶

La Hadi, A., Alibasa, M. J., Chen, G., & Asyhari, A. T. (2025). The “Easy Trap”: Why LLMs Underestimate Misconception-Driven Difficulty. https://arxiv.org/abs/2607.26067 doi:10.48550/arxiv.2607.26067

q2 · i? · associational · r2

Analysis of student response distributions for the five most underestimated fraction items (Table 3) shows "errors are not random but reflect systematic misconception patterns"; e.g., 34.2% correct on P32 with common wrong answers 50 and 100.

"Common incorrect responses include “division makes smaller” beliefs, whole-number bias, inappropriate operation selection, and incorrect reasoning about magnitude."

Discussion¶

Learner Variables¶

• Proportional Reasoning — predictor: learners who differ on it differ in outcomes

Related Claims¶

• LLMs systematically underestimate fraction items whose difficulty is driven by misconceptions (the \"Easy Trap\") — a broader claim this one bears on
• Behavioural analytics alone cannot distinguish the cognitive origins of identical learner errors — related
• Correct-answer-trap cases concentrate in specific question types where common flawed reasoning happens to produce the correct numerical answer, with the top two question types accounting for 71% of all TM cases — related
• In Save Patch, different error types were associated with different learning outcomes, attributed to Kerr and Chung (2013b) — related