Instructional designers' main challenges with ChatGPT are output quality (53.8%), tool limitations (42.3%), and faculty unpreparedness (3.8%)¶

Claim · All claims
Evidence · 1 study · qualitative r2 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2030: baselines and conditions change

Subclaims¶

q2 i? Output quality problems, including hallucinations and bias, were the most frequent challenge (53.8% of responses). → Fan Yang · Jill E. Stefaniak 2025 q2 i? Tool limitations accounted for 42.3% and faculty unpreparedness 3.8% of challenge responses. → Fan Yang · Jill E. Stefaniak 2025

Evidence¶

Fan Yang · Jill E. Stefaniak 2025¶

Fan Yang · Jill E. Stefaniak. (2025). An exploration of instructional designers' prioritizations for integrating ChatGPT in design practice. Education Tech Research Dev. https://doi.org/10.1007/s11423-025-10509-7

q2 · i? · qualitative · r2

Inductive thematic analysis of challenge responses (N = 26) identified three themes; the article states "Table 4 presents a total of three types of challenges, including the quality of the output, tool limitations, and faculty unpreparedness." Output quality concerns included hallucinations, bias, and nonexistent references; tool limitations included prompt misunderstanding and tone problems.

"Table 4 presents a total of three types of challenges, including the quality of the output, tool limitations, and faculty unpreparedness."

Discussion¶

Related Claims¶

• The most frequently cited ethical concerns about GenAI in research were hallucinated facts, fabricated references, and misleading content — related
• The most reported risks of AI tools in science and chemistry education are ethical issues, including gender and racial bias, hallucinations, copyright infringement, and plagiarism — related
• Limited output accuracy and over-reliance are the most pressing challenges Chinese HSS students report in GenAI use, alongside strong ethical concern — related
• Students perceive LLM chatbots as useful for learning but requiring critical use, reporting hallucinations, overconfidence, and dependency risks — related
• Students report negative experiences with ChatGPT including inaccurate outputs, lack of emotional connection, and risk of overreliance, which constrain competence — related
• Students' main AI challenges are content reliability and depth, and most expect AI to serve as tutor, creative partner, and critical thinking partner rather than mere content generator — related
• Teachers report concerns about infrastructure, reliability, age appropriateness, teacher competence, and student over-reliance on AI — related
• Faculty focus groups raised concerns about authenticity, validity, and reliability of ChatGPT-generated SBMCQs, including cultural and linguistic bias — related
• IDs expressed quality concerns over GenAI-generated content, including bias, inaccuracy, hallucinations, and lack of authenticity — a broader claim this one bears on
• Faculty hold more tempered views of LLMs than students (51% vs 74% positive), centred on clinical reasoning development and content reliability — related