Students' questions shift from broad to specific during Socratic AI tutoring, from about 10–15% specific in the first turn to all students asking specific questions by the final turn¶

Claim · All claims
Evidence · 1 study · associational r1 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The proportion of students asking specific, content-focused questions rose from about 10–15% in the first turn to approximately 58% by the fourth turn and to all students by the final turn. → Syed Furqan Abbas Hashmi 2025

Evidence¶

Syed Furqan Abbas Hashmi 2025¶

Syed Furqan Abbas Hashmi, N. Sanjay Rebello. (2025). Analyzing Undergraduate Problem-Solving in Physics Through Interaction With an AI Chatbot. https://arxiv.org/abs/2508.14778 doi:10.48550/arxiv.2508.14778

q2 · i? · associational · r1

Transcript analysis of student–chatbot dialogues from the same 150-student session, coding each student question as broad or specific. The analysis found "a general progression from broad questions to specific questions as the dialogue advanced," with dialogues averaging about 5–6 student question turns.

"In the first turn, only about 10–15% of students asked a specific physics question. However, as the session continued, students' questions became more targeted. By the fourth turn in the dialogue, approximately 58% of students were asking specific, content-focused questions"

Discussion¶

Related Claims¶

• Question specificity during Socratic AI tutoring correlates mildly but positively with self-reported expected course grade (Pearson r ≈ 0.43), with substantial scatter — related
• Students primarily used the Socratic-tutor chatbot as a study aid aligned with existing study habits rather than for the intended Socratic reflection — related
• The chatbot often provided more scaffold types than requested, and supplying classified question scope to the chatbot raised scaffold precision above .60 — related
• Meta-procedural requests are prominent in student discourse with a Socratic AI tutor: Next Step Guidance is the second-most common discourse move despite the tutor being designed not to direct students — related