Outline strategies and technological interventions to alleviate over-reliance and foster responsible use of AI dialogue systems¶

Strategy · All strategies
Evidence · 5 claims (5 for) · 3 studies (3 review), q1–q2 · 0 of 3 report an effect size · 5 claims rest on one study

Description¶

The review commits to outlining potential strategies and technological interventions to alleviate the challenges of over-reliance on AI dialogue systems, "aiming to foster responsible use of AI dialogue systems". It positions such interventions as the response to ethical concerns including hallucination, algorithmic bias, plagiarism, privacy and transparency, and to the cognitive risks of dependency. The review also argues that integration of AI dialogue systems into educational and research practices should be conducted in a manner that is both ethically sound and cognitively enriching.

Design Implications¶

Context¶

Requirements¶

• Interventions must address the identified ethical issues of AI (hallucination, bias, plagiarism, privacy, transparency) that contribute to over-reliance

Constraints¶

• The review notes the existing literature lacks a comprehensive analysis of the impacts of these ethical concerns or strategies for mitigating the risks

Target Learners¶

• students and researchers in higher education

Target Learning Goals¶

• responsible use of AI dialogue systems
• preservation of critical thinking and independent analysis

Claims¶

• A systematic review reports that over-reliance on AI dialogue systems fosters complacency and dependency and may weaken students' decision-making [+W]
• Over-reliance on AI dialogue systems reduces students' critical and analytical thinking skills, especially when they become overly dependent on AI-generated content [+W]
• Excessive dependence on AI may reduce human interaction and dehumanize adult education [+W]
• Over-reliance on AI scaffolding risks learned helplessness, so focus should shift to fostering self-regulated AI interaction [+W]
• Among 245 Indonesian undergraduates, majorities reported concern about reduced critical thinking when depending on AI (75%), excessive reliance (73%), misinformation (70%) and unintentional plagiarism (69%), and 40% about algorithmic bias [+W]

Related Strategies¶

• Enhance students' AI literacy while alleviating excessive academic stress to reduce over-dependence on generative AI
• Integrate AI literacy instruction into study programs alongside responsible tool design
• Six-step design methodology: elicit values, minimal intervention, multi-level multi-outcome evaluation, iterate, simulate scale, sunset

Examples¶

-

Key Sources¶

• Chunpeng Zhai, Santoso Wibowo and Lily D. Li. (2024). The effects of over-reliance on AI dialogue systems on students' cognitive abilities: a systematic review. Smart Learning Environments. https://doi.org/10.1186/s40561-024-00316-7