EVS usability scores above 'good' benchmark but students become more critical of usability when encountering staff competency or testing problems¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2015 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The SUS score for EVS was 74%, placing it above 'good' but below 'excellent', yet usability items split across two components suggesting divided student views. → Marija Cubric 2015

Evidence¶

Marija Cubric 2015¶

Marija Cubric, and Amanda Jefferies. (2015). The benefits and challenges of large-scale deployment of electronic voting systems: University student views from across different subject groups. Computers & Education. https://doi.org/10.1016/j.compedu.2015.04.004

q2 · i? · associational · r2

SUS usability scale administered as part of the survey; the modified 10-item SUS with an additional accessibility question produced a single score of 74%.

"The SUS score for EVS was calculated to be 74%. According to Bangor et al. (2008) benchmarking, this score places EVS above “good” (M=72.75) but below “excellent” (M=85.58) in the “Mean SUS table”."

Discussion¶

Related Claims¶

• Summative assessment and staff competencies are the most frequently reported challenges in students' free-text responses about EVS dissatisfaction — related
• The experimental group rated AVDS usability as excellent while the control group rated it as good — related
• First-time builders completed the v4.1 build in a mean of 39.1 minutes with SUS 74.6 (Good), but showed higher assembly Mental Demand than developers and tactile fragility concerns around snap-fit components — a narrower finding that bears on this claim
• Learner acceptance of AI simulations is generally high, with System Usability Scale scores of 61.6 to 78.56 and 72%-93% willingness to recommend — a broader claim this one bears on
• The FACTRIA-aware chatbot received good usability ratings (SUS 70.84) and high usefulness ratings from most of the 11 stakeholders — related
• 93% of students rated usability and control as important to their learning — related