Survey scores show directional consistency with dialogue behavior: students with higher knowledge-based survey scores tended to have above-average question specificity and higher expected grades¶

Claim · All claims
Evidence · 1 study · associational r1 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Students with higher Knowledge-Based survey scores often had above-average question specificity and higher grades, while those reporting lower confidence or motivation tended to ask more broad questions. → Syed Furqan Abbas Hashmi 2025

Evidence¶

Syed Furqan Abbas Hashmi 2025¶

Syed Furqan Abbas Hashmi, N. Sanjay Rebello. (2025). Analyzing Undergraduate Problem-Solving in Physics Through Interaction With an AI Chatbot. https://arxiv.org/abs/2508.14778 doi:10.48550/arxiv.2508.14778

q2 · i? · associational · r1

Exploratory analysis connecting survey results to dialogue features in the same 150-student dataset. The authors describe the insights as "preliminary" and report directional consistency rather than tested correlations; no statistics are printed for these relationships.

"students with higher Knowledge – Based survey scores often had above- average question specificity and higher grades. Those who reported lower confidence or motivation (survey section 2) tended to ask more broad questions and sometimes struggled more."

Discussion¶

Related Claims¶

• Question specificity during Socratic AI tutoring correlates mildly but positively with self-reported expected course grade (Pearson r ≈ 0.43), with substantial scatter — related
• Questioning Strategies Improve Learning — related
• Some classroom discussion approaches improve text comprehension, but gains are not uniform across approaches and more student talk alone does not produce them — related
• Students rarely formulated questions specifying both knowledge component and scaffold type during chatbot problem-solving — related
• HelpCoach increased spontaneous question specificity during chatbot problem-solving compared with pre-task training alone — related