Reporting errors were significantly reduced in every training session of the VBSA-trained group compared to the control group, and implementation errors were reduced from first to last training session¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r1 · q3
Currency · newest study 2018 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Reporting errors were reduced significantly in each training session in the experiment set compared to the control group. → Damacharla 2018 q3 i? Implementation errors were only reduced from the first to the last set of training in the experiment group compared to the control group. → Damacharla 2018 (2)

Evidence¶

Damacharla 2018¶

Damacharla, P., Dhakal, P., Stumbo, S., Javaid, A. Y., Ganapathy, S., Malek, D. A., Hodge, D. C., & Devabhaktuni, V. (2018). Effects of Voice-Based Synthetic Assistant on Performance of Emergency Care Provider in Training. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-018-0166-3

q3 · i? · causal · r1

Error-count comparison between groups across the three training sessions, summarized in Table 3 with two-tailed Wilcoxon tests (all p < 0.05). "Reporting errors were reduced significantly in each training session in the experiment set"; no effect size is printed.

"Results indicate that reporting errors were reduced significantly in each training session in the experiment set compared to the control group."

Damacharla 2018 (2)¶

Damacharla, P., Dhakal, P., Stumbo, S., Javaid, A. Y., Ganapathy, S., Malek, D. A., Hodge, D. C., & Devabhaktuni, V. (2018). Effects of Voice-Based Synthetic Assistant on Performance of Emergency Care Provider in Training. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-018-0166-3

q3 · i? · causal · r1

Implementation error counts in Table 3 (e.g., control IMP 15 to 7 across training; experiment IMP 9 to 9) show the "implementation errors were only reduced from the first set to the last set of training"; no effect size is printed.

"Implementation errors were only reduced from the first set to the last set of training in the experiment group compared to the control group."

Discussion¶

Related Claims¶

• The voice-based synthetic assistant interface showed very low false-positive rates in interaction with trainees, suggesting reliable rejection of unwanted commands — related
• Novice trainees trained with a voice-based synthetic assistant achieved significantly higher performance scores than conventionally trained trainees on the third test of a hemorrhage treatment scenario — related
• Training with the voice-based synthetic assistant caused no statistically significant loss in task execution time and no significant time difference between groups across testing scenarios — related
• Repetitive training with the synthetic assistant produced statistically significant performance growth across successive tests, whereas the control group's growth was largely insignificant — related
• The training effect is somewhat weaker for tasks presented at the end of the one-hour battery, suggesting a fatigue effect — related