Learning-oriented engagement is recurrent but selective in everyday human–LLM conversations, with cognitive engagement in 31.9% and constructive engagement in 4.9% of user turns¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2031: baselines and conditions change

Subclaims¶

q2 i? Across 491,685 user turns in three public corpora, 31.9% showed cognitive engagement and 4.9% reached constructive engagement, the deepest observable user-side signal. → Chen 2026

Evidence¶

Chen 2026¶

Chen, Z., Li, H., Xiao, Z., Qu, H., & Xie, X. (2026). Informal learning emerges in everyday human–LLM interaction. arXiv. https://arxiv.org/abs/2607.17643 doi:10.48550/arxiv.2607.17643

q2 · i? · associational · r2

Observational analysis of 128,569 naturalistic conversations from WildChat, LMSYS Chat and ShareChat, with LLM-assisted turn-level annotation. The study reports that "31.9% showed cognitive engagement and 4.9% reached constructive engagement", so deeper sense-making was recurrent but selective.

"Across 491,685 user turns, 31.9% showed cognitive engagement and 4.9% reached constructive engagement, a subset of cognitive engagement and the deepest observable user-side signal in the annotation scheme"

Discussion¶

Related Claims¶

• The ICAP Framework was found effective for assessing potential for active learning in an asynchronous online environment and identifying where design improvements are needed — the general claim this finding bears on, with the studies behind it
• Constructive engagement is ecologically organized: amplified by explicit learning-oriented framing, higher in coding than writing, and more visible in sustained exchanges — related
• Coding-oriented conversations show higher cognitive and constructive engagement than writing-oriented conversations across all three corpora — related
• Adjacent-turn support–engagement coupling is state- and form-dependent: explaining predicts constructive follow-up after all prior states, while feedback's positive association concentrates after prior passive turns — related
• 78.8% of student-GenAI turns lack mastery-oriented aims and reliable epistemic strategies — related
• Trained students engage in more conversational turns with the GenAI tool — related
• Scaffolded assistant support marks richer constructive participation at the conversation level across all six task settings — related
• Support form differentiates the scaffolding–engagement association: feedback and explaining align most with constructive engagement, with a task-ecology crossover between instructing and modelling — related