Conceptual Questions about mathematics are a strong negative indicator of assignment 6 scores¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · no dated study recorded · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In spring regressions, the specific dialogue act Conceptual Question - Mathematics significantly and negatively predicted the assignment 6 (n-gram language model) score. → reg-math-a6

Evidence¶

reg-math-a6¶

Hunter McNichols, Fareya Ikram, and Andrew Lan. 2026. The StudyChat Dataset: Analyzing Student Dialogues With ChatGPT in an Artificial Intelligence Course. In LAK26: 16th International Learning Analytics and Knowledge Conference (LAK 2026). https://doi.org/10.1145/3785022.3785029

q2 · i? · associational · r2

Spring-semester specific-DA regression analysis. The Mathematics conceptual-question feature had a significant negative coefficient for a6 (−0.1062, p=0.002), an assignment requiring students to build an n-gram language model with probability tables and derived equations. The authors suggest students "potentially deriving incorrect solutions from the model or receiving inaccurate guidance."

"One notable exception is thatConceptual Question - Mathematicsis a strong negative indi- cator of a6 score."

Discussion¶

Related Claims¶

• Students' conceptual-question and editing-request LLM usage is positively correlated with exam outcomes in the spring semester — related
• Contextual Questions dialogue acts are negatively correlated with assignment outcomes across both semesters — a broader claim this one bears on
• Dialogue act features raise regression R² but do not significantly improve outcome prediction over a prior-performance baseline — related