Training with the voice-based synthetic assistant caused no statistically significant loss in task execution time and no significant time difference between groups across testing scenarios¶

Claim · All claims
Evidence · 1 study · causal r1 · q3
Currency · newest study 2018 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Both groups reduced testing time across iterations (experiment z = −2.6694, p = 0.00758; control z = −2.8682, p = 0.0041), with no significant difference between the groups. → Damacharla 2018

Evidence¶

Damacharla 2018¶

Damacharla, P., Dhakal, P., Stumbo, S., Javaid, A. Y., Ganapathy, S., Malek, D. A., Hodge, D. C., & Devabhaktuni, V. (2018). Effects of Voice-Based Synthetic Assistant on Performance of Emergency Care Provider in Training. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-018-0166-3

q3 · i? · causal · r1

Wilcoxon signed-rank tests on testing-phase times across iterations for both groups. An "increase in training iterations reduced the time taken in the testing section by both groups" (experiment z = −2.6694; control z = −2.8682); no effect size is printed.

"two-tailed Wilcoxon sign ranked test (experimental = (z = −2.6694, p = 0.00758 for p < 0.05), control = (z = −2.8682, p = 0.0041 for p < 0.05)) validates our hypothesis that an increase in training iterations reduced the time taken in the testing section by both groups"

Discussion¶

Related Claims¶

• The voice-based synthetic assistant interface showed very low false-positive rates in interaction with trainees, suggesting reliable rejection of unwanted commands — related
• AI assistance reduces task completion time in both education groups, the only outcome without an equalizing pattern — related
• Reporting errors were significantly reduced in every training session of the VBSA-trained group compared to the control group, and implementation errors were reduced from first to last training session — related
• Repetitive training with the synthetic assistant produced statistically significant performance growth across successive tests, whereas the control group's growth was largely insignificant — related
• Novice trainees trained with a voice-based synthetic assistant achieved significantly higher performance scores than conventionally trained trainees on the third test of a hemorrhage treatment scenario — related