Chatbot users held more positive attitudes and reported greater perceived knowledge gains than non-users¶

Claim · All claims
Evidence · 1 study · associational r1 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Users of the chatbot had significantly more positive attitudes toward chatbot use in education than non-users, and agreed to a greater extent that chatbots improved their knowledge and understanding. → Stephen Colbran 2026

Evidence¶

Stephen Colbran 2026¶

Stephen Colbran, Meena Jha and Caitlin Schiavone. (2026). Understanding student perspectives on generative AI chatbots: a human-centred mixed-methods study in higher education. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-026-00605-w

q3 · i? · associational · r1

One-way ANOVA comparing users and non-users on 5-point Likert items (3 neutral) in the RQ1 results: users' attitude mean was 2.00 versus non-users' 2.78 (p < .001, df = 117); users also agreed more that chatbots "improved their knowledge and understanding ( p < .001, df = 117)" (mean 2.15 vs 2.82).

"Users had significantly more positive attitudes toward chatbot use in education (mean = 2.00) than non-users (mean = 2.78) (p < .001, df = 117) indicating very strong statistical evidence that there is a significant difference between the means of the groups being compared."

Discussion¶

Related Claims¶

• Students hold generally positive attitudes toward educational chatbots and agree the chatbots they used improved their knowledge and understanding — related
• Prior chatbot exposure rather than general technological literacy is associated with willingness to use chatbots — related
• Non-users cite lack of training, distrust of responses, preference for teaching staff, academic-integrity fear and lack of interest as reasons for not using chatbots — related
• Gender, age and English proficiency show nuanced group differences in chatbot attitudes and concerns — related
• Students in the generative AI-supported condition reported favorable attitudes toward AI-supported geometry learning, with moderate confidence in technology use — related
• Teachers' attitudes toward GenAI tools significantly predict their behavioural intention to integrate them — related
• Higher GenAI usage clusters report greater perceived difficulty, lower self-assessed understanding, and different trust in AI-generated code — related
• Premium-access GenAI users report greater perceived benefits than free-only users, largest for tasks beyond current expertise — related
• Students express willingness to integrate GenAI in learning and future careers, and willingness correlates with knowledge and frequency of use — related
• Students using LecturaAgents reported stronger perceived understanding, assessment readiness, and future learning support than comparison-tool users — related