First queries from Cold Start learners were overwhelmingly dependent (96.7%), contrasting with mostly guided first queries from Oriented (69.1%) and Struggling (71.4%) learners¶

Claim · All claims
Evidence · 1 study · design r3 · q2
Currency · no dated study recorded · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? 96.7% of labeled first queries from Cold Start learners were dependent, compared with 30.9% and 28.6% dependent rates for Oriented and Struggling learners. → w1-1

Evidence¶

w1-1¶

David Barron, Xiaohang Tang, Rezky Dwisantika, Minsun Kim, David H. Smith IV, Jiaming Cui, and Yan Chen. 2026. TutorTrace: A Dataset and Taxonomy for Classifying Learner Behavioral States during AI-Assisted Programming Education. https://arxiv.org/abs/2608.26184 doi:10.48550/arxiv.2608.26184

q2 · i? · design · r3

Descriptive analysis of guided/dependent labels (GPT-4o, validated against two human raters, κ=.897) across Window 1 behavioral profiles in the TutorTrace dataset. The article interprets these as descriptive associations, not causal effects.

"In Window 1, 96.7% of labeled first queries from Cold Start learners were dependent. In contrast, first queries from Oriented and Struggling learners were more often guided (69.1% and 71.4%, respectively)."

Discussion¶

Related Claims¶

• Window 1 profiles complicate the assumption that greater pre-query effort signals better progress: Cold Start learners completed at 97% while Struggling learners completed at 67% — related
• Student chatbot queries were overwhelmingly task-oriented initial inquiries, dominated by definition requests and pasted assignment questions rather than iterative critique — related
• Observable metrics computed from IDE telemetry improved held-out prediction of query imminence (AUROC .726) and guided versus dependent help-seeking (AUROC .717) over raw telemetry — related
• Explanatory inquiries, factual queries, and tutorial requests are the most frequent LLM learning tasks — related