DD students were less likely to dismiss explanations while GG students were more likely to dismiss them, with no statistically significant differences in use themes¶

Claim · All claims
Evidence · 1 study · causal r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In thematic analysis of how students used the explanations, DD students were less likely to dismiss explanations (resid = −1.21) while GG students were more likely to do so (resid = +0.72) and less likely to mention conceptual support (resid = −0.80); no differences reached statistical significance. → Seth Bernstein 2026

Evidence¶

Seth Bernstein 2026¶

Seth Bernstein, Paul Denny, Juho Leinonen, Kush Patel, Rayhona Nasimova, Matt Littlefield, and Stephen MacNeil. (2026). Exploring the Value of Diverse LLM Explanations in Introductory Programming. SIGCSE Virtual '26. https://arxiv.org/abs/2606.28882 doi:10.48550/arxiv.2606.28882

q2 · i? · causal · r2

Thematic analysis of responses to the question asking students to reflect on whether and how they used the explanations, coded into Strategic Use, Conceptual Support, and Dismissed categories; Strategic Use was mentioned by over 75% of students in each group, and no differences reached statistical significance.

"DD students were less likely to dismiss explanations (resid = –1.21), while GG students were more likely to do so (resid = +0.72) and less likely to mention conceptual support (resid = –0.80)."

Discussion¶

Related Claims¶

• Residual analysis of perception themes showed DD students more likely to report Engaged Understanding and less likely to report Overload/Frustration, though chi-square tests were not significant — related
• Students perceived diverse and generic explanations as similarly helpful, with no statistically significant difference across explanation-sequence groups — related
• Diverse LLM explanations were associated with about 7.7% higher open-ended response accuracy than generic explanations, but the condition effect was not significant after Bonferroni adjustment — related