Students' self-reported AI literacy was moderately negatively correlated with objectively measured AI competency, suggesting potential overestimation of AI abilities¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q2 i? Correlating self-reported AI literacy with an independent objective AI competency score yielded a moderate negative correlation (r = −0.39) that was not statistically significant (p ≈ 0.21). → Hosseini 2026

Evidence¶

Hosseini 2026¶

Hosseini, H. (2026). The Pedagogy of AI Mistakes: Fostering Higher-Order Thinking. https://arxiv.org/abs/2605.05472 doi:10.48550/arxiv.2605.05472

q2 · i? · design · r2

Correlational analysis in the prior-knowledge survey of the 13-student course, comparing six adapted self-report AI-literacy questions (from AILQ and MAILS) with five objective multiple-choice AI competency questions. The authors report "a moderate negative correlation (r=−0.39) that is not statistically significant (p≈0.21)" and interpret it as possible overestimation.

"correlating self-reported AI literacy with objective competency, we find a moderate negative correlation (r=−0.39) that is not statistically significant (p≈0.21), but could suggest potential overestimation of AI abilities among students."

Discussion¶

Related Claims¶

• Teachers' self-reported AI literacy correlates only weakly with their objectively measured performance (r = 0.07–0.24) — related
• Adding a cross-factor composite from a teacher study yields r = .079, still with an interval including zero, and latent profiles reveal over- and underestimation of competence — related
• SR–OB profile patterns differ by prior AI literacy experience: overestimation appears only among experienced teachers and a low–low profile only among inexperienced teachers — related
• Latent profile analysis of combined SR and OB factors identifies six distinct teacher profiles spanning overestimation, underestimation, and alignment — related
• Perceived and objectively demonstrated AI literacy show only limited alignment in the same samples (pooled r = .055, interval including zero) — related
• Unidimensional measurement of SPT leaves the SPT–conflict resolution relationship unclear — related
• Perceived usefulness of ChatGPT, an invalid cue, is associated with overestimation of performance — related