Residual analysis of perception themes showed DD students more likely to report Engaged Understanding and less likely to report Overload/Frustration, though chi-square tests were not significant¶

Claim · All claims
Evidence · 1 study · causal r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In thematic analysis of open-ended feedback, students receiving diverse explanations in both stages (DD) were more likely than expected to mention Engaged Understanding (resid = +0.48) and less likely to report Overload/Frustration (resid = −1.49), but no chi-square test reached statistical significance. → Seth Bernstein 2026

Evidence¶

Seth Bernstein 2026¶

Seth Bernstein, Paul Denny, Juho Leinonen, Kush Patel, Rayhona Nasimova, Matt Littlefield, and Stephen MacNeil. (2026). Exploring the Value of Diverse LLM Explanations in Introductory Programming. SIGCSE Virtual '26. https://arxiv.org/abs/2606.28882 doi:10.48550/arxiv.2606.28882

q2 · i? · causal · r2

Thematic analysis based on Braun and Clarke's guidelines of open-ended feedback from the 785 students providing OE responses, with co-occurring themes clustered into Engaged Understanding, Active Monitoring, and Overload/Frustration and tested with chi-square tests of independence; none reached statistical significance.

"Students in the DD condition were more likely than expected to mention Engaged Understanding (resid = +0.48) and less likely to report Overload/Frustration (resid = −1.49). Conversely, students in the DG group were more likely to report Overload/Frustration (resid = +1.16)."

Discussion¶

Learner Variables¶

• Achievement Emotions — outcome: instruction changes it

Related Claims¶

• DD students were less likely to dismiss explanations while GG students were more likely to dismiss them, with no statistically significant differences in use themes — related
• Diverse LLM explanations were associated with about 7.7% higher open-ended response accuracy than generic explanations, but the condition effect was not significant after Bonferroni adjustment — related
• Students perceived diverse and generic explanations as similarly helpful, with no statistically significant difference across explanation-sequence groups — related