Use data-grounded simulation as a pre-deployment close-the-loop tool for ITS design decisions¶

Strategy · All strategies
Evidence · no claims cited

Description¶

Before classroom deployment, run simulations grounded in real student interaction data using standard EDM models (AFM, BKT) to systematically compare alternative design configurations, such as levels of learner control and system constraints. The article treats this as "a complementary pre-deployment tool that reduces risk and helps identify which learner behaviors and system interventions warrant targeted classroom evaluation". This accelerates iteration and helps avoid deploying inequitable or suboptimal interventions on real students.

Design Implications¶

Context¶

Requirements¶

• Open-source learner interaction data from the target ITS domain
• Standard student models (AFM and BKT) fit to the data
• Open-source learner simulation libraries

Constraints¶

• Simulation findings must later be validated through in vivo experimentation
• The modeled strategies and constraints must be grounded in prior empirical work

Target Learners¶

• ITS researchers and designers evaluating shared-control tutoring systems

Target Learning Goals¶

• data-driven redesign of task-selection and constraint policies in mastery learning systems

Affordances¶

• Sim Task Selection Constraint Framework

Related Strategies¶

• Simulation-based pre-validation of adaptive coaching systems before classroom deployment

Examples¶

-

Key Sources¶

• Haley Noh, Aarna Chowdhary, Jeroen Ooge, Vincent Aleven, Conrad Borchers. (2026). Simulating Learners' Task-Selection Strategies and System Constraints in Mastery Learning. arXiv preprint. https://arxiv.org/abs/2605.21613