AI is currently not best practice for competency-based micro-credential assessment; human assessors remain indispensable¶

Claim · All claims
Evidence · 1 study · theoretical r1 · q1
Currency · newest study 2024 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person
Evidence quality · No study behind this claim is a peer-reviewed article with a DOI: it rests on a source with no registered publication record (a web page, book or unpublished report). It is kept because a design page cites it; treat it as a lead to check, not an established finding.

Subclaims¶

q1 i? The authors state that using AI for competency-based assessments is currently not best practice because AI lacks contextual understanding and subject-matter expertise, limiting it to pattern recognition and statistical analysis. → ai-1

Evidence¶

ai-1¶

Galindo, M., Fennelly-Atkinson, R., Franklin, K., Luna, C. (2024, August). The Role of Micro-Credentials in Lifelong Learning and Development: Empowering Learners, Empowering Organizations. Digital Promise. https://digitalpromise.dspacedirect.org/items/8c5402d0-2102-43c7-844f-f88419f4618b org/10 51388/20 500 12265/225

q1 · i? · theoretical · r1

Author position statement in the eBook's AI chapter, citing Bubeck et al. (2023). The article offers no empirical test of its own; it argues AI "needs more specific contextual understanding and subject matter expertise for accurate evaluation" while remaining optimistic about future applications that enhance equitable access without compromising quality and trust.

"Assessing skills and competencies is crucial in micro-credentialing, but using AI for assessments, especially competency-based work, is currently not the best practice (Bubeck et al., 2023)."

Discussion¶

Related Claims¶

• Fairness of AI outputs remains under-evaluated in edtech research — related
• Fine-tuned PLMs measure high-inference teaching practices better when the variable requires less pedagogical expertise, matching human-rater agreement on lexical variables but degrading on inference-heavy ones — related
• AI was found lacking in diagnosing student misconceptions because models do not understand lack of logic or sense making — a narrower finding that bears on this claim
• AI-generated diagnostic information is inherently incomplete, focusing on performance data and omitting contextual and motivational information — related
• El uso de IA para evaluaciones basadas en competencias no es actualmente la mejor práctica — possibly the same claim (merge candidate)
• AI and peer feedback differed in complementary ways: AI gave general, rubric-driven, actionable feedback while peers gave more specific, contextual feedback — related