IDs expressed quality concerns over GenAI-generated content, including bias, inaccuracy, hallucinations, and lack of authenticity¶

Claim · All claims
Evidence · 1 study (2 entries) · qualitative r3 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q2 i? Almost all IDs expressed concerns over the quality of GenAI-generated content, recognizing it could be biased, inaccurate, unauthentic, and less creative. → Luo 2025 q2 i? A majority of IDs (N = 9) agreed that prompt engineering is a needed skill for accurate results. → Luo 2025 (2)

Evidence¶

Luo 2025¶

Luo, T., Muljana, P. S., Ren, X., & Young, D. (2025). Exploring instructional designers' utilization and perspectives on generative AI tools: A mixed methods study. Education Tech Research Dev, 73, 741–766. https://doi.org/10.1007/s11423-024-10437-y

q2 · i? · qualitative · r3

Thematic analysis of interviews (RQ4). "Almost all IDs expressed concerns over the quality of GenAI-generated content," with participants citing bias in image generation, hallucinations in citations and historical facts, and the need to maintain an authorial voice.

"Almost all IDs expressed concerns over the quality of GenAI-generated content, recognizing that they could be biased, inaccurate, unauthentic, and less creative."

Luo 2025 (2)¶

Luo, T., Muljana, P. S., Ren, X., & Young, D. (2025). Exploring instructional designers' utilization and perspectives on generative AI tools: A mixed methods study. Education Tech Research Dev, 73, 741–766. https://doi.org/10.1007/s11423-024-10437-y

q2 · i? · qualitative · r3

Thematic analysis of interviews (RQ4). A majority of IDs (N = 9) "agreed that prompt engineering is a needed skill for accurate results," acknowledging it takes time and proper training rather than being an instantaneous process.

"Therefore, a majority of IDs (N = 9) agreed that prompt engineering is a needed skill for accurate results."

Discussion¶

Related Claims¶

• Instructional designers' main challenges with ChatGPT are output quality (53.8%), tool limitations (42.3%), and faculty unpreparedness (3.8%) — a narrower finding that bears on this claim
• The most frequently cited ethical concerns about GenAI in research were hallucinated facts, fabricated references, and misleading content — related
• GenAI feedback limitations require students to exercise evaluative judgement — related
• AI systems can produce biased or inaccurate diagnostic outputs, requiring critical teacher evaluation before integration — related
• Qualities metaphors depicted GenAI as unknowable, unreliable and unbounded, with participants unsettled by its opacity — related
• Pessimistic Evaluators' foremost concern is misleading, inaccurate, or biased ChatGPT-generated information — related
• Scholars raise three main concerns about AI chatbots in education: reliability and accuracy, fair assessment, and ethical issues — related
• Trainees and trainers hold mixed views on AI-generated heat maps for postoperative coaching — related