Paired self-report and objective-based AI literacy assessment instruments for K–12 teachers¶
Product or Programme · All products and programmes
Evidence · 4 claims (3 for, 1 mixed) · 4 studies (3 associational, 1 quant-synthesis),q2· 1 of 4 report an effect size · 4 claims rest on one study
Description¶
A psychometrically validated scenario-based multiple-choice test and Likert self-report scale developed to measure K–12 teachers' AI literacy across knowledge, application, evaluation and creation, and ethics.
Components¶
Claims¶
- The objective-based AI literacy assessment demonstrates psychometric stability with high reliability (KR-20 = 0.862) and approximate unidimensionality [+M]
- The self-report measure supports a refined 13-item, four-factor model with good fit [+M]
- Teachers' self-reported AI literacy correlates only weakly with their objectively measured performance (r = 0.07–0.24) [+M]
- Perceived and objectively demonstrated AI literacy show only limited alignment in the same samples (pooled r = .055, interval including zero) [~W]
Related Products and Programmes¶
-
Key Sources¶
- Shan Zhang, Ruiwei Xiao, Anthony F. Botelho, Guanze Liao, Thomas K. F. Chiu, John Stamper, and Kenneth R. Koedinger. 2026. How to Assess AI Literacy: Misalignment Between Self-Reported and Objective-Based Measures. In LAK26: 16th International Learning Analytics and Knowledge Conference (LAK 2026). ACM, New York, NY, USA. https://doi.org/10.1145/3785022.3785088
Page metadata
| Field | Value |
|---|---|
type |
product |
id |
paired-self-report-and-objective-based-ai-literacy-assessment-instruments-for-k12-teachers |
title |
Paired self-report and objective-based AI literacy assessment instruments for K–12 teachers |
description |
A psychometrically validated scenario-based multiple-choice test and Likert self-report scale developed to measure K–12 teachers' AI literacy across knowledge, application, evaluation and creation, and ethics. |
status |
review |
product_kind |
assessment |
generated |
by process:settle-candidates on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.