AI literacy scales show good structural validity and internal consistency but are rarely tested for other measurement properties¶
Claim · All claims
Evidence · 1 study · reviewr3·q2
Currency · newest study 2024 · checked against its sources 2026-10-26 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Across the 16 scales, structural validity and internal consistency evidence is good, while content validity, reliability, construct validity, and responsiveness were tested in only a few scales, and cross-cultural validity and measurement error in none. → Tomáš Lintner 2024
Evidence¶
Tomáš Lintner 2024¶
Tomáš Lintner. (2024). A systematic review of AI literacy scales. npj Science of Learning 9:50. https://doi.org/10.1038/s41539-024-00264-4
q2 · i? · review · r3
COSMIN and GRADE-based quality assessment (Table 2) of the 16 scales; the review reports "good structural validity and internal consistency" overall, with no scale tested for cross-cultural validity or measurement error.
"Overall, the scales demonstrated good structural validity and internal consistency. On the other hand, only a few have been tested for content validity, reliability, construct validity, and responsiveness. None of the scales have been tested fo r cross-cultural validity and measurement error."
Discussion¶
Related Claims¶
- TAILS dimensions show high internal consistency, with Cronbach's alpha values above 0.90 — related
- Questionnaire constructs showed acceptable to strong internal consistency (α = 0.740 to 0.945) — related
- The post-interaction reflection instrument showed satisfactory internal consistency (Cronbach's α = .863) — related
- The 16-item CT–PCK Survey shows internal consistency reliability around .71–.72 and person separation reliability of .69 — related
- The post-study survey instrument showed high internal consistency (alpha = 0.90) — related
- CTAT shows robust psychometric properties for higher education CS/AI students, with reliable internal consistency and adequate IRT item parameters — related
- The MAKQ dimensions show acceptable internal consistency across both studies (alphas 0.77-0.93) — related
- A 2024 systematic review identified 22 studies validating 16 AI literacy scales, most of them self-report rather than performance-based — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
ai-scales-structural-validity-strong-other-properties-untested |
title |
AI literacy scales show good structural validity and internal consistency but are rarely tested for other measurement properties |
description |
AI literacy scales show good structural validity and internal consistency but are rarely tested for other measurement properties |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2024 |
source_checked |
2026-10-26 |
generated |
by process:wiki-ingest on 2026-10-26 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — tomáš-lintner-2024 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.