Design TTXs with assessment in mind so that log data capture the learning process¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The authors recommend that TTX creators consider assessment goals during the design phase, because a thorough design of learning objectives and activities is crucial for automated assessment to work; otherwise the log data may be less accurate in capturing the learning process. Building milestone structure and activity alignment into the exercise from the start enables higher-quality analytics in the post-TTX phase, supporting timely cluster-differentiated feedback.

Design Implications¶

Context¶

Requirements¶

• TTX learning objectives and activities must be thoroughly designed before the exercise runs

Constraints¶

Target Learners¶

• student teams in cybersecurity and computing education

Target Learning Goals¶

• incident response competencies
• teamwork
• professional communication

Related Strategies¶

• Be cautious with LLM-based TTX assessment and have a human instructor review automated outputs
• Combine log-derived behavioral engagement measures with process data and self-report to assess learner engagement in AI-supported practice

Examples¶

-

Key Sources¶

• V. Švábenský, J. Vykopal, S. Leelaluk, P. Čeleda, F. Okubo, A. Shimada. (2026). Assessment in Team Problem-Solving Exercises in Computing Education. Proceedings of the 56th IEEE Frontiers in Education Conference (FIE '26). https://arxiv.org/abs/2607.19209