Adults rated the LLM-powered iCub storytelling system as usable, with a total SUS score of 76.70 indicating good product usability¶

Claim · All claims
Evidence · 1 study · design r2 · q3
Currency · newest study 2025 · checked against its sources 2026-10-24 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

q3 i? In a usability study with 25 adult participants, the iCub narrative system reached a total SUS score of 76.70, which the authors interpret as overall good product usability. → Maria Lombardi 2025

Evidence¶

Maria Lombardi 2025¶

Maria Lombardi, Carmela Calabrese, Davide Ghiglino, Caterina Foglino, Davide De Tommaso, Giulia Da Lisca, Lorenzo Natale, Agnieszka Wykowska. (2025). Would you let a humanoid play storytelling with your child? A usability study on LLM-powered narrative Human-Robot Interaction. https://arxiv.org/abs/2508.02505 doi:10.48550/arxiv.2508.02505

q3 · i? · design · r2

Post-interaction usability assessment in the validation experiment: 26 adults were recruited (one excluded), each inventing three stories with iCub, then completing the SUS. The article reports the total score of 76.70 and cites an empirical evaluation of the questionnaire for the interpretation.

"The total score reached 76.70, which indicates an overall good product usability according to an empirical evaluation of the questionnaire [34]."

Discussion¶

Related Claims¶

• Participants liked the co-created stories (mean likability 8.61) and perceived them as coherent (mean coherence 8.28) on a 1-10 scale — related
• The iCub storytelling system achieved 88% trial success and 86% VLM sticker-description agreement, with the LLM adding to human contributions in 8% of trials and never correcting them — related
• The FACTRIA-aware chatbot received good usability ratings (SUS 70.84) and high usefulness ratings from most of the 11 stakeholders — related
• After design adjustments, the LAD achieved good–excellent usability (SUS M = 4.13, equal to 78.25%) — related
• The Bloom classification UI shows low perceived workload and high usability in a 50-participant user study — related
• Students rated the usability of the AIvaluate assessment in the SUS 'good' range — related
• Special-education practitioners rated AdaptED Stories as strongly usable, with a mean SUS score of 86.8 corresponding to an A grade — related
• Participants identified children under 10 as the intended target group for the storytelling robot, significantly more than all other age groups — related
• System usability was rated low in both conditions, with no significant difference between them — related
• The system receives a good average usability rating (SUS 69.7, grade B) but with wide individual variation, which the authors take to suggest UI consistency issues — related
• Learner acceptance of AI simulations is generally high, with System Usability Scale scores of 61.6 to 78.56 and 72%-93% willingness to recommend — related
• Students rated AISSA's usability as excellent, with an average SUS score of 83.38 from 30 of 46 pilot students — related
• Experimental-group participants rated TibetCPR highly usable (SUS = 84.3, an Excellent rating), with the highest items on voluntary engagement and independent use — related