The evaluation was a blind, two-condition study in which 30 informatics students ran the Bio-safety Lab scenario both with and without the Narrative Manager across three stages¶

Claim · All claims
Evidence · 1 study · causal r2 · q2
Currency · newest study 2014 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Thirty participants were randomly assigned to two groups that were blind to condition; each ran two sessions in their assigned condition and then, in a third stage, ran the other condition to compare interest. → Alvarez 2014

Evidence¶

Alvarez 2014¶

Alvarez, N., Sanchez-Ruiz, A., Cavazza, M., Shigematsu, M., & Prendinger, H. (2014). Narrative Balance Management in an Intelligent Biosafety Training Application for Improving User Performance. Int J Artif Intell Educ 25, 35–59. https://doi.org/10.1007/s40593-014-0022-z

q2 · i? · causal · r2

Controlled experiment at the National Institute of Informatics in Tokyo with "A total of 30 subjects participated, 17 male and 13 female, all informatics students"; sessions were 12 minutes or until all spills were cleared, followed by questionnaires.

"The experiment consisted of 3 stages: first the user does a stage to learn about the domain and controls of the application, and then in the second and third stages the users run two training sessions in the Bio-safety Lab application with and without Narrative Manager."

Discussion¶

Related Claims¶

• In disagreement cases, blinded educators more frequently prefer CLARA developmental estimates over publisher recommendations — related
• CLARA annotations align with blinded educator judgments, with 0.81 pairwise agreement and highest-rated educational interpretability — related
• Task progression graphs show difficult Narrative Manager events raise the distance-to-goal curve while assistive events such as hiding materials produce flat zones that cost user time