Repetitive training with the synthetic assistant produced statistically significant performance growth across successive tests, whereas the control group's growth was largely insignificant¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r1 · q3
Currency · newest study 2018 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Wilcoxon signed-rank tests showed significant Pscore growth between tests 1–2 (z = −2.1976, p = 0.0278) and tests 2–3 (z = −3.5162, p = 0.00044) in the experiment group, but not in the control group for those intervals. → Damacharla 2018 q3 i? Both groups showed significant growth from test 1 to test 3 (control z = −2.1315, p = 0.03318; experiment z = −3.5162, p = 0.00044). → Damacharla 2018 (2)

Evidence¶

Damacharla 2018¶

Damacharla, P., Dhakal, P., Stumbo, S., Javaid, A. Y., Ganapathy, S., Malek, D. A., Hodge, D. C., & Devabhaktuni, V. (2018). Effects of Voice-Based Synthetic Assistant on Performance of Emergency Care Provider in Training. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-018-0166-3

q3 · i? · causal · r1

Within-group Wilcoxon signed-rank analyses of Pscores across the three iterations in the VBSA-trained group. The "experimental group between tests 1 and 2" and tests 2 and 3 both showed significant improvement; the control group's corresponding tests were not significant. No effect sizes are printed.

"The same test applied on the experimental group between tests 1 and 2 (z = −2.1976, p = 0.0278 for p < 0.05) and tests 2 and 3 (z = −3.5162, p = 0.00044 for p < 0.05) indicated a statistically significant difference in"

Damacharla 2018 (2)¶

Damacharla, P., Dhakal, P., Stumbo, S., Javaid, A. Y., Ganapathy, S., Malek, D. A., Hodge, D. C., & Devabhaktuni, V. (2018). Effects of Voice-Based Synthetic Assistant on Performance of Emergency Care Provider in Training. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-018-0166-3

q3 · i? · causal · r1

Wilcoxon signed-rank comparison of control-group Pscores from test 1 to test 3 showed "statistically significant growth existed from test 1 to test 3" (z = −2.1315, p = 0.03318); no effect size is printed.

"Nevertheless, statistically significant growth existed from test 1 to test 3 (z = −2.1315, p = 0.03318 for p < 0.05)."

Discussion¶

Related Claims¶

• The voice-based synthetic assistant interface showed very low false-positive rates in interaction with trainees, suggesting reliable rejection of unwanted commands — related
• Reporting errors were significantly reduced in every training session of the VBSA-trained group compared to the control group, and implementation errors were reduced from first to last training session — related
• Training with the voice-based synthetic assistant caused no statistically significant loss in task execution time and no significant time difference between groups across testing scenarios — related
• Novice trainees trained with a voice-based synthetic assistant achieved significantly higher performance scores than conventionally trained trainees on the third test of a hemorrhage treatment scenario — related