AI overviews in an academic search engine showed mixed effects: summaries may reduce mental demand and frustration for some users, with slightly fewer clicks and query reformulations¶

Claim · All claims
Evidence · 1 study · causal r? · q2
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i? In a within-subjects user study, SERP-level AI summaries may reduce mental demand and frustration for some users, while participants descriptively performed slightly fewer clicks and query reformulations; overall effects were mixed. → Yifan Liu 2026

Evidence¶

Yifan Liu 2026¶

Yifan Liu, Jaime Arguello, Orland Hoeber, Chang Liu, Soo Young Rieh, Luanne Sinnamon, et al. (2026). Report on CHIIR 2026 Workshop on Generative AI and Academic Search (GAI&AS). ACM SIGIR Forum. https://arxiv.org/abs/2606.08936 doi:10.48550/arxiv.2606.08936

q2 · i? · causal · r?

A within-subjects user study in a social science academic search engine compared interfaces with and without a single SERP-level summary synthesized from the five top-ranked results, combined with an accuracy assessment across expert-sourced queries. The report states "the overall effects were mixed"; no effect size is printed.

"Results suggested that summaries may reduce mental demand and frustration for some users, while participants descriptively performed slightly fewer clicks and query reformulations. At the same time, the overall effects were mixed."

Discussion¶

Learner Variables¶

Affect Regulation — outcome: instruction changes it

Students using Google produce higher-quality justifications in their final recommendations than students using ChatGPT 3.5 — the general claim this finding bears on, with the studies behind it
Browsing term lists (selection mode) helps searchers who do not know the exact query term — the general claim this finding bears on, with the studies behind it
AI assistance reduces subjective mental effort across all tasks even when it does not reduce completion time, dissociating time and effort — related
Transparency features are shown but seldom consulted: cited sources in AI summaries were clicked in only 1% of visits — related
Google Trends data show ChatGPT search interest surged globally within weeks of its November 2022 public release, with plagiarism among the top related queries — related

Page metadata

Field	Value
`type`	`claim`
`id`	`ai-overviews-mixed-effects-academic-search`
`title`	`AI overviews in an academic search engine showed mixed effects: summaries may reduce mental demand and frustration for some users, with slightly fewer clicks and query reformulations`
`description`	`AI overviews in an academic search engine showed mixed effects: summaries may reduce mental demand and frustration for some users, with slightly fewer clicks and query reformulations`
`status`	`review`
`evidence_strength`	`weak`
`newest_evidence`	`2026`
`source_checked`	`2026-10-20`
`generated`	by `process:wiki-ingest` on `2026-10-10`
`trust`	unverified — no one has confirmed this page's content
`sources`	1 — `yifan-liu-2026`

Frontmatter is the page's machine-readable record — see the Schema & Guide.