Interaction and usability challenges affect 85.3% of reviewed CAI articles, with usability problems most observable in mature rule-based agents¶
Claim · All claims
Evidence · 1 study · reviewr2·q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2030: baselines and conditions change
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Interaction and usability challenges appear in 85.3% of review articles, with general-CAI reviews contributing 69%, combined reviews 13.8%, and GenAI-category reviews 17.2%. → Amrita Ganguly 2025
q2 i? Reported usability issues include limited modalities, misleading answers, inadequate personalization, lack of emotion and empathy, and persona effects. → Amrita Ganguly 2025
Evidence¶
Amrita Ganguly 2025¶
Amrita Ganguly, Nafisa Mehjabin, Aqdas Malik, Aditya Johri. (2025). Conversational AI agents in education: an umbrella review of current utilization, challenges, and future directions for ethical and responsible use. AI and Ethics. https://doi.org/10.1007/s43681-025-00916-0
q2 · i? · review · r2
Thematic synthesis of challenge themes by agent type across the 34 reviews (RQ2). The review reports the distribution of interaction and usability challenges across agent categories and lists issues including "limited modalities, misleading answers, inadequate personalization".
"Interaction and usability challenges appear in 85.3% of review articles, with reviews of general CAI contributing 69%, combined reviews 13.8%, and GenAI category 17.2%."
Discussion¶
Related Claims¶
- CAI-in-education research shows a framework gap: no end-to-end design guidance, weak CAI-specific usability methods, unclear pedagogical guidance, and limited AI literacy support — related
- CAI-in-education review literature is concentrated in higher education and in language, health, and general education domains — related
- CAI utilization in education is concentrated in pedagogical applications, with administrative, research, and healthcare-education applications least represented — related
- Human-AI relationship concerns persist across all CAI generations while academic integrity and data privacy are emerging ethical concerns — related
- Rigorous investigation of GenAI's actual educational and cognitive effects remains limited despite increasing integration into learning environments — related
- Ethics, privacy, bias, over-reliance, accuracy, usability and cost are key challenges AI use poses for learner satisfaction and engagement — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
cai-interaction-usability-challenges-prevalence |
title |
Interaction and usability challenges affect 85.3% of reviewed CAI articles, with usability problems most observable in mature rule-based agents |
description |
Interaction and usability challenges affect 85.3% of reviewed CAI articles, with usability problems most observable in mature rule-based agents |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2025 |
recheck_by |
2030 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — amrita-ganguly-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.