Most introductory physics students preferred a combination chatbot (guidance first, answers when stuck), while few preferred pure guided Q&A¶
Claim · All claims
Evidence · 1 study · associationalr1·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Among activity respondents, 52% chose Combination, 39.6% chose Direct Answers, and only 7.6% chose Guided Q&A as their anticipated chatbot preference. → Amogh Sirnoorkar and Omkar Mamidpalliwar 2026
Evidence¶
Amogh Sirnoorkar and Omkar Mamidpalliwar 2026¶
Amogh Sirnoorkar and Omkar Mamidpalliwar. (2026). Students' Epistemological Beliefs and their Chatbot Preferences in AI-mediated Physics Learning. https://arxiv.org/abs/2607.29385 doi:10.48550/arxiv.2607.29385
q2 · i? · associational · r1
Descriptive preference counts from the second page of an extra-credit waves activity in a large-enrollment calculus-based physics course, captured before completion. As printed, "52% highlighted the “Combination” option" and only 7.6% chose Guided Q&A.
"While 52% highlighted the “Combination” option, 39.6% preferred “Direct Answers”. Only 7.6% highlighted the “Guided Q&A” preference."
Discussion¶
Related Claims¶
- Students preferring combination-style chatbots had higher total EBAPS scores than students preferring direct-answer chatbots (nominal significance only) — related
- Chatbot preference groups differed in total EBAPS and Axis 4/5 scores at the nominal level, with small effect sizes, but not after Bonferroni adjustment — related
- Unguarded answer-giving AI harmed unaided exam performance while a guarded version of the same model erased the harm (Bastani et al., 2025, as reported) — related
- No statistically significant EBAPS differences were observed for Axes 1–3 or between guided-inquiry and answer-oriented chatbot preferrers — related
- Combination-preferring students scored higher than answer-preferring students on evolving-knowledge (Axis 4) and source-of-ability (Axis 5) EBAPS dimensions — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
students-prefer-combination-chatbot-over-guided-qa |
title |
Most introductory physics students preferred a combination chatbot (guidance first, answers when stuck), while few preferred pure guided Q&A |
description |
Most introductory physics students preferred a combination chatbot (guidance first, answers when stuck), while few preferred pure guided Q&A |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — amogh-sirnoorkar-and-omkar-mamidpalliwar-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.