Claims

Students predominantly recommended future students use office hours and formal course staff, with LLMs positioned as a supplement

Claim · All claims
Evidence · 1 study (2 entries) · qualitative r2–r3 · q2
Currency · newest study 2026 · checked against its sources 2026-10-18 (automated, 2 of 2 entries) · not reviewed by a person

Subclaims

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i? In the Week 13 advice-to-future-students reflections, students predominantly recommended office hours and commented on how helpful the TAs were, while recommending LLMs for assistance tasks like test cases or documentation. → Margaret Ellis 2026 q2 i? Students recommended starting assignments early, trying problems on their own first, and seeking help in order to understand the material rather than just get answers. → Margaret Ellis 2026 (2)

Evidence

Margaret Ellis 2026

Margaret Ellis, Nikitha Donekal Chandrashekar, Sehrish Basir Nizamani, Mohammed Farghally, Jake O'Brien, and Naren Ramakrishnan. (2026). Demystify, Use, Reflect, Assess (DURA): An Experience Report on LLM Integration in CS2. arXiv. https://arxiv.org/abs/2606.30908 doi:10.48550/arxiv.2606.30908

q2 · i? · qualitative · r2

Qualitative coding of Week 13 advice responses using 35 codes for recommendations for future help-seeking. Students also cautioned LLM use, e.g., to avoid AI doing large parts of the work. No effect size printed.

"Similar to Penney's findings [27], students predominantly recommended that future students use office hours and they commented on how helpful the TAs were."

Margaret Ellis 2026 (2)

Margaret Ellis, Nikitha Donekal Chandrashekar, Sehrish Basir Nizamani, Mohammed Farghally, Jake O'Brien, and Naren Ramakrishnan. (2026). Demystify, Use, Reflect, Assess (DURA): An Experience Report on LLM Integration in CS2. arXiv. https://arxiv.org/abs/2606.30908

q2 · i? · qualitative · r3

Same Week 13 advice analysis: students also explicitly recommended trying problems on their own first or reviewing course materials, and said the main reason to seek assistance is to understand the material. Descriptive; no effect size.

"There was a noticeable trend to recommend starting assignments early in order to be able to get help and not be overwhelmed."

Discussion

Page metadata
Field Value
type claim
id students-recommend-office-hours-over-llms
title Students predominantly recommended future students use office hours and formal course staff, with LLMs positioned as a supplement
description Students predominantly recommended future students use office hours and formal course staff, with LLMs positioned as a supplement
status review
evidence_strength weak
newest_evidence 2026
source_checked 2026-10-18
generated by process:wiki-ingest on 2026-10-10
trust unverified — no one has confirmed this page's content
sources 2 — margaret-ellis-2026, margaret-ellis-2026-2

Frontmatter is the page's machine-readable record — see the Schema & Guide.