AI literacy instruction widened a confidence-knowledge gap: students' perceived understanding of AI tools increased significantly after instruction while actual knowledge improved minimally¶

Claim · All claims
Evidence · 1 study · review r2 · q2
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i? Prior empirical work found students' perceived understanding of AI tools increased significantly after instruction, but actual knowledge improved minimally. → Yifan Liu 2026

Evidence¶

Yifan Liu 2026¶

Yifan Liu, Jaime Arguello, Orland Hoeber, Chang Liu, Soo Young Rieh, Luanne Sinnamon, et al. (2026). Report on CHIIR 2026 Workshop on Generative AI and Academic Search (GAI&AS). ACM SIGIR Forum. https://arxiv.org/abs/2606.08936 doi:10.48550/arxiv.2606.08936

q2 · i? · review · r2

The report attributes this finding to prior empirical work by Archambault et al. (2025), cited in a lightning talk on designing for discernment; the reviewed study's design is not described in the report. No effect size is printed.

"Prior empirical work reveals a troubling confidence-knowledge gap: while students' perceived understanding of AI tools increased significantly after instruction, actual knowledge improved minimally [Archambault et al., 2025]."

Discussion¶

Learner Variables¶

Self-Efficacy — outcome: instruction changes it

Self-efficacy judgments correspond less well to behavior in learning settings than in performance settings — the general claim this finding bears on, with the studies behind it
Fluent Illusions Mislead Self Assessment — related
The GenAI session strengthened immediate AI-handling confidence and workflow literacy, but students remained hesitant about transferring these skills to employment — related
People use AI on simple tasks at a rate significantly higher than they predict for themselves (self-estimate miscalibration), especially on easy task variants — related
Some GenAI tools can inhibit productive struggle by reducing cognitive effort (metacognitive laziness) — related
AI-assisted practice applications improved music students' performance outcomes, self-efficacy, and self-regulated learning — related

Page metadata

Field	Value
`type`	`claim`
`id`	`ai-literacy-confidence-knowledge-gap`
`title`	`AI literacy instruction widened a confidence-knowledge gap: students' perceived understanding of AI tools increased significantly after instruction while actual knowledge improved minimally`
`description`	`AI literacy instruction widened a confidence-knowledge gap: students' perceived understanding of AI tools increased significantly after instruction while actual knowledge improved minimally`
`status`	`review`
`evidence_strength`	`weak`
`newest_evidence`	`2026`
`source_checked`	`2026-10-20`
`generated`	by `process:wiki-ingest` on `2026-10-10`
`trust`	unverified — no one has confirmed this page's content
`sources`	1 — `yifan-liu-2026`

Frontmatter is the page's machine-readable record — see the Schema & Guide.