The nine AI demonstrations drew high attendance but modest engagement, with student feedback sharply split on course utility¶
Claim · All claims
Evidence · 1 study · causalr1·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Among 60 demo-section respondents, 28 attended all nine demonstrations, most reported slight or moderate engagement, and feedback split between direct course utility (10) and lacking course utility (11), with the dominant suggestion being to increase course utility (13). → Shuang Geng 2026
Evidence¶
Shuang Geng 2026¶
Shuang Geng, Helen Lallos-Harrell, Jiya Ashar, Thomas J. McKenna, Annwesa Dasgupta, Caleb Farny, and Emma Lejeune. (2026). Structured AI Demonstrations and Student LLM Use in Engineering Mechanics: Study Design and Preliminary Results. https://arxiv.org/abs/2607.28710 doi:10.48550/arxiv.2607.28710
q2 · i? · causal · r1
Post-survey demonstration feedback from 60 demo-section respondents, coded with the adjudicated machine pipeline. Attendance was self-reported (28 of 60 attended all nine); "The most frequent like was direct course utility (10) and the most frequent dislike was lacked course utility (11)".
"The most frequent like was direct course utility (10) and the most frequent dislike was lacked course utility (11), with redundancy for students who already knew the material close behind (7)."
Discussion¶
Related Claims¶
- A six-session faculty learning community on AI was implemented in a physics department, engaging nineteen faculty across biweekly meetings — related
- Participants simultaneously affirmed ChatGPT feedback as useful while rejecting it as final grader, treating feedback utility and evaluative authority as separate judgements — related
- Viewing of the personalized AI videos declined sharply across the quarter, with views of the first week-9 video set suggesting fewer than 10% of the course population was watching voluntarily by the end of the course — related
- Students who continued feedback conversations with ChatGPT perceived more utility in AI feedback than one-shot users — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
ai-demonstrations-split-on-course-utility |
title |
The nine AI demonstrations drew high attendance but modest engagement, with student feedback sharply split on course utility |
description |
The nine AI demonstrations drew high attendance but modest engagement, with student feedback sharply split on course utility |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — shuang-geng-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.