Evidence for sustained or clinically meaningful outcomes of AI chatbot coaching is mixed and does not guarantee improvement across outcomes¶
Claim · All claims
Evidence · 1 study · reviewr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Sustained improvement in some outcomes or populations does not guarantee sustained improvement across all outcomes: an RCT found AI did not improve sustained weight loss in dieting children, and an uncontrolled study's symptom reductions cannot be attributed to the chatbot. → Potel 2026
Evidence¶
Potel 2026¶
Potel, J. T., & Kumashiro, M. (2026). Artificial Intelligence as a Personal Coach: A Narrative Review of Benefits and Risks in Educational and Health Contexts. Behavioral Sciences, 16(8), 1431. https://doi.org/10.3390/bs16081431
q2 · i? · review · r2
The review cites an RCT (Stasinaki et al.) where AI incorporation did not improve sustained weight loss, and an uncontrolled study (Daley et al.) where stress, anxiety, and depression reductions could not be specifically attributed to chatbot use.
"when used to counsel dieting children in a long-term randomized controlled trial, incorporating AI did not improve sustained weight loss, although there were improvements in other physical outcomes"
Discussion¶
Learner Variables¶
- Physical Well-Being — outcome: instruction changes it
Related Claims¶
- Purpose-built AI chatbots show generally promising short-term improvements in physical activity and dietary behaviors — related
- Purpose-built AI chatbot coaching is generally well received and supports short-term motivation and selected behavior change, but effects on sustained, meaningful outcomes are inconsistent — a broader claim this one bears on
- Reported outcomes of AI-supported university physics education are mixed and context-dependent, and the evidence does not support a conclusion that AI is uniformly effective — related
- A quasi-experimental intervention reported short-term reductions in loneliness followed by lower social anxiety after a social-chatbot intervention — related
- Purpose-built chatbot effects on educational performance are mixed, with some studies showing no benefits or worse outcomes than comparison conditions — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
sustained-clinical-outcomes-mixed-ai-coaching |
title |
Evidence for sustained or clinically meaningful outcomes of AI chatbot coaching is mixed and does not guarantee improvement across outcomes |
description |
Evidence for sustained or clinically meaningful outcomes of AI chatbot coaching is mixed and does not guarantee improvement across outcomes |
status |
review |
evidence_strength |
mixed |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-12 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — potel-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.