Students' self-assessed question specificity was not significantly correlated with their observed specificity¶

Claim · All claims
Evidence · 1 study · causal r1 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q2 i? Self-reported specificity showed no significant correlation with observed specificity in any Study 1 condition, with signals for negative correlations. → Hyoungwook Jin 2026

Evidence¶

Hyoungwook Jin 2026¶

Hyoungwook Jin, Weirui Peng, Jieun Han, Q. Vera Liao, and Xu Wang. (2026). HelpCoach: Scaffolding Targeted AI Help-Seeking During Problem-Solving. arXiv. https://arxiv.org/abs/2609.28918 doi:10.48550/arxiv.2609.28918

q2 · i? · causal · r1

Survey-based correlational analysis in the Study 1 classroom deployment (44 undergraduates): students rated their question specificity on a 7-point Likert scale. Spearman correlations with observed specificity were non-significant in all conditions, e.g., r_Baseline = .080, p = .778.

"Self-reported speci- ficity was not significantly correlated with observed specificity in any condition (Spearman's correlation:𝑟𝐵𝑎𝑠𝑒𝑙𝑖𝑛𝑒 =. 080,𝑝𝐵𝑎𝑠𝑒𝑙𝑖𝑛𝑒 = .778,𝑟𝑇𝑒𝑚𝑝𝑙𝑎𝑡𝑒 =−. 475,𝑝𝑇𝑒𝑚𝑝𝑙𝑎𝑡𝑒 =. 101,𝑟𝐹𝑒𝑒𝑑𝑏𝑎𝑐𝑘 =−. 043,𝑝𝐹𝑒𝑒𝑑𝑏𝑎𝑐𝑘 = .833); instead, we observed signals for negative correlations even."

Discussion¶

Related Claims¶

• Self Assessment Accuracy Is Low Without Training — the general claim this finding bears on, with the studies behind it
• Topic-level assistant question volume correlates significantly with student self-reported topic difficulty (Spearman ρ = 0.491, p = 0.008, 28 matched topics) — related
• Tell and no-agent conditions showed no significant JoL–confidence correlations, with mixed results for progress and mastery — related
• In StudyChat, conceptual-understanding behaviors correlate positively with exam outcomes while task-delegating behaviors correlate negatively — related
• HelpCoach increased spontaneous question specificity during chatbot problem-solving compared with pre-task training alone — related