Task progression graphs show difficult Narrative Manager events raise the distance-to-goal curve while assistive events such as hiding materials produce flat zones that cost user time¶

Claim · All claims
Evidence · 1 study · causal r2 · q1
Currency · newest study 2014 · not yet checked against its sources · not reviewed by a person
Design limits · Alvarez 2014: no comparison group (read from the study by two models, 2026-10-27)

Subclaims¶

q1 i? In single-subject task progression graphs, difficult events such as a spill overflow raise the curve slightly because actions must be redone, and negative events that hide materials produce flat zones where the user searches instead of progressing. → Alvarez 2014

Evidence¶

Alvarez 2014¶

Alvarez, N., Sanchez-Ruiz, A., Cavazza, M., Shigematsu, M., & Prendinger, H. (2014). Narrative Balance Management in an Intelligent Biosafety Training Application for Improving User Performance. Int J Artif Intell Educ 25, 35–59. https://doi.org/10.1007/s40593-014-0022-z

q1 · i? · causal · r2

Qualitative reading of the task progression graph of one Narrative Condition subject (subject one). The overflow is described as "a light inconvenience that requires some actions to be redone"; hiding materials instead yields a flat zone of searching.

"when an event which is difficult for the user happens, the curve rises; for example, when the spill overflows, the curve rises a bit because is a light inconvenience that requires some actions to be redone."

Discussion¶

Related Claims¶

• The Narrative Manager generated an additional full spill task for users advancing quickly, widening their distance to the goal by 23 points, while slow users received only small difficulties — related
• The evaluation was a blind, two-condition study in which 30 informatics students ran the Bio-safety Lab scenario both with and without the Narrative Manager across three stages
• Trait-score trajectories over time are inconclusive as learning-curve evidence: one StudyChat trait increases while the significant SWE-Chat traits stay flat
• In Graphical Jogthrough, evaluators’ ratings yield a graph of estimated proportion of effective users versus the time needed to achieve effectiveness — related
• Graphical Jogthrough applied to educational software offers quantitative and qualitative data for a rough estimation of the novice–becoming–expert pace — related