Self-reported instruments measure AI self-efficacy (perceptions) rather than AI literacy abilities, so both should be included in comprehensive assessment¶

Claim · All claims
Evidence · 1 study · design r3 · q1
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q1 i? The authors argue that a self-reported approach can only examine perceptions of using and evaluating AI (self-efficacy), not abilities and skills (literacy), which require tests or examinations. → Thomas K. F. Chiu 2025

Evidence¶

Thomas K. F. Chiu 2025¶

Thomas K. F. Chiu, Murat Çoban, Ismaila Temitayo Sanusi, Musa Adekunle Ayanwale. (2025). Validating student AI competency self-efficacy (SAICS) scale and its framework. Education Tech Research Dev. https://doi.org/10.1007/s11423-025-10512-y

q1 · i? · design · r3

A conceptual argument in the literature-review section, not a tested result. The authors reason that self-reported items capture feelings and thinking, and conclude that "both AI self-efficacy and AI literacy should be included in a more comprehensive assessment of student learning."

"However, a self-reported approach can only examine participants' perceptions of using and evaluating AI (i.e., AI self-efficacy) but not their abilities and skills (i.e., AI literacy). AI literacy should be measured by tests or examinations similar to international literacy assessment programs"

Discussion¶

Related Claims¶

• Teachers' self-reported AI literacy correlates only weakly with their objectively measured performance (r = 0.07–0.24) — a narrower finding that bears on this claim
• Prior Knowledge Needed For Accurate Self Assessment — a broader claim this one bears on
• Questionnaire data may capture learners' perceptions rather than the strategies they actually performed — possibly the same claim (merge candidate)
• Findings are limited by perception-based self-report measures and a single online context, requiring further research on generalizability — related
• Integrating examination-based and non-examination-based assessments is the most effective strategy for identifying weaknesses in clinical reasoning skills — related
• The Assessment of Clinical Skills/Competence/Performance framework indicates four domains of competence: knowledge, competence, performance, and action. — related