Tag assessments with explicit taxonomy levels to analyse whether exam difficulty distribution matches instructional intent¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The article recommends that assessments carry explicit taxonomy-level tags so instructors can calibrate examination difficulty and construct parallel versions using explicit criteria rather than subjective judgment. It states: "Assessments should carry explicit taxonomy-level tags, enabling post-hoc analysis of whether the difficulty distribution of an exam matches instructional intent." The automatic classifier supports this by allowing instructors to classify novel commands on demand without domain expertise for each case.

Design Implications¶

Context¶

Requirements¶

• A shared four-level taxonomy applied consistently across course materials and exams

Constraints¶

• Manual expert classification of the combinatorially large command space does not scale; automated assignment is proposed to address this

Target Learners¶

• instructors of command-line and systems administration courses

Target Learning Goals¶

• calibrated assessment difficulty and systematic identification of student competence boundaries

Related Strategies¶

• Design assignments and assessment environments with observability of cognitive participation in mind

Examples¶

-

Key Sources¶

• Alonso-Carracedo, M., Fernandez-Boullon, R., Celard, P., Rodríguez-Martínez, F. J., & Otero-Cerdeira, L. (2026). CogTax: A Four-Level Cognitive Taxonomy for Command-Line Computing Education. arXiv. https://arxiv.org/abs/2607.00140. doi:10.48550/arxiv.2607.00140