Interpretability and feasibility of AI literacy scales remain largely unknown, and open raw data is scarce¶
Claim · All claims
Evidence · 1 study · reviewr3·q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Most scale validation studies did not report interpretability indicators such as missing data and floor/ceiling effects, and almost none provided open raw data or completion times. → Tomáš Lintner 2024
Evidence¶
Tomáš Lintner 2024¶
Tomáš Lintner. (2024). A systematic review of AI literacy scales. npj Science of Learning 9:50. https://doi.org/10.1038/s41539-024-00264-4
q2 · i? · review · r3
Assessment of interpretability (score distributions, missing data, floor/ceiling effects, Tables 3–4) and feasibility across the 16 scales; the review reports "almost none had raw data available" and most completion times were not reported.
"Most studies did not report any interpretability indicators and almost none had raw data available."
Discussion¶
Related Claims¶
- Test scores at the floor of a test's score scale contain real information about students' performance, so floor scores do not distort teacher value-added estimates — related
- Research on AI support for EL literacy remains limited, narrow in scope, and lacking for diverse EL subgroups — related
- AI-based assessment practices within PBL contexts remain underdeveloped, with limited empirical evidence on automated feedback, formative assessment, and learning analytics — related
- A 2024 systematic review identified 22 studies validating 16 AI literacy scales, most of them self-report rather than performance-based — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
ai-scale-interpretability-feasibility-unreported |
title |
Interpretability and feasibility of AI literacy scales remain largely unknown, and open raw data is scarce |
description |
Interpretability and feasibility of AI literacy scales remain largely unknown, and open raw data is scarce |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2024 |
generated |
by process:wiki-ingest on 2026-10-26 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — tomáš-lintner-2024 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.