Students reported positive usability and acceptance of MentorChat¶

Claim · All claims
Evidence · 1 study · causal r1 · q2
Currency · newest study 2013 · not yet checked against its sources · not reviewed by a person
Design limits · Tegos 2013: no comparison group (read from the study by two models, 2026-10-27)

Subclaims¶

q2 i? Students rated interface understanding, role understanding, response time, enjoyment, and perceived learning experience highly on a 5-point scale. → Tegos 2013

Evidence¶

Tegos 2013¶

Tegos, S., Demetriadis, S., & Tsiatsos, T. (2013). A Configurable Conversational Agent to Trigger Students' Productive Dialogue: A Pilot Study in the CALL Domain. Int J Artif Intell Educ. https://doi.org/10.1007/s40593-013-0007-3

q2 · i? · causal · r1

Post-task questionnaire with 25 items (21 Likert-scale) completed by 30 students after the collaborative activity; indexed variables showed "perceived ease-of-use of system" M=4.75 (SD=0.27) and perceived usefulness of peer discussions M=4.44 (SD=0.70).

"A statistical analysis of all questionnaire variables indicated positive student opinions regarding their understanding of the interface functions ( M=4.77, SD=0.21) and of their roles in the activity ( M=4.77, SD=0.11), the system response time ( M=4.50, SD=0.90), the enjoyment derived from their discussions ( M=4.47, SD=0.77), and the perceived quality of the learning experience ( M=4.30, SD=0.99)."

Discussion¶

Related Claims¶

• Teachers rate LearnLens positively across usability, relevance, and accuracy, with all nine Likert items averaging at least 4.1/5 — related
• A post-exam survey found the DOT-format online exam well received: 76.9% of students rated time sufficiency 3 or above and 80.8% rated interface convenience 3 or above on 5-point scales. — related
• 91% of UAT participants rated the Taklif.AI user interface as intuitive — related
• Students rated Zoo U highly for engagement and likeability, with every usability area rated at least 3.8 on a four-point scale — related
• Participants rated SOPHIE 2.0 as engaging, easy to use, and clinically relevant in a self-service format — related
• Older adults rated the KOKU digital programme with excellent usability and high acceptability — related
• In an exploratory pilot, students perceived the course-specific RAG system's responses as highly aligned with course materials (89%) and helpful for assessment understanding — related
• In preliminary user acceptance testing, 84% of participants rated Taklif.AI's personalization feature as beneficial — related
• A second experiment evaluated system acceptance with a scenario followed by 21 users who filled out a questionnaire — related