Use a mixed-methods assessment sequence: diagnostic inventory, structured verification tasks, and discipline-specific critique or workflow-design assignments¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The article recommends combining validated self-report instruments with performance-based and process-focused assessment. "Effective AI literacy assessment requires a mixed-methods approach that combines existing validated instruments with performance-based assessments aligned to the continuum." A practical sequence begins with a low-stakes diagnostic inventory, moves into structured verification tasks, and culminates in discipline-specific critique or workflow-design assignments, with process evidence such as prompt histories and revision notes.

Design Implications¶

Context¶

Requirements¶

• Triangulation of self-report, artifact analysis, and process evidence rather than reliance on any single instrument

Constraints¶

• Standard instruments may assume a baseline of engagement, so reflective journaling and pre-course surveys are needed to identify Stage 0–1 behaviors

Target Learners¶

• higher education students

Target Learning Goals¶

• diagnosing AI literacy stage
• distinguishing genuine understanding from surface performance

Affordances¶

• Ai Literacy Continuum Five Stages

Related Strategies¶

• Use the AI Fatigue Model to adjust task design, pacing, and scaffolding at points where AI-related pressure is likely to increase
• Assess process over product using staged, connected tasks with iterative evidence
• Move beyond generic AI policies to method-based ethical policies and process-oriented assessment
• Use SR and OB measures together as diagnostic tools in AI literacy professional development, before and after training
• Diagnostic Assessment
• Design curricula giving students opportunities to critically engage with AI and AI-generated content through validation, interpretation, and revision tasks
• Explore hybrid assessment models combining AI conversational agent-based and face-to-face formats, with long-term study of effects on performance and well-being
• Replace detector-centred assessment with a four-stage process-oriented model: declared starting point, versioned drafting, process artefacts, and targeted oral verification
• Design AI-supported programming courses with critique-the-AI phases, planned fading, and verification journals

Examples¶

-

Key Sources¶

• Liu, J. P., & Levy, R. (2026). Beyond Tool Adoption: A Practical Five-Stage Developmental Continuum for AI Literacy in Higher Education. North Carolina State University. https://arxiv.org/abs/2606.00038. doi:10.48550/arxiv.2606.00038