Perceived overall utility of generative AI differs significantly across the five platforms used, favoring platforms with structured task breakdowns¶
Claim · All claims
Evidence · 1 study (2 entries) · associationalr1·q2·i3large
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i3 A one-way ANOVA showed a significant difference among AI platforms (ChatGPT, Gemini, DeepSeek, Meta AI, Copilot) in overall perceived utility, F(4, 126) = 6.52, p < .001, η² = .17. → George Efthimiou 2026
q2 i? Post-hoc Tukey HSD tests indicated platforms with higher structured task breakdowns were significantly more useful than general conversational LLMs. → George Efthimiou 2026 (2)
Evidence¶
George Efthimiou 2026¶
George Efthimiou, Katerina Plakitsi. (2026). Preservice Early Childhood Educators' Engagement with Generative AI in Science Activity Design: The Case of Magnetism. https://www.mdpi.com/journal/educationsciences doi:10.35542/osf.io/m5erf_v1
q2 · i3 · associational · r1
One-way ANOVA (N = 131) comparing overall perceived utility across five generative AI platforms, reported in the findings section with "F (4, 126) = 6.52, p < .001" and η² = .17.
"The test showed a significant difference among platforms in overall perceived utility scores F (4, 126) = 6.52, p < .001, 𝜂2= .17 (Table 3 )."
George Efthimiou 2026 (2)¶
George Efthimiou, Katerina Plakitsi. (2026). Preservice Early Childhood Educators' Engagement with Generative AI in Science Activity Design: The Case of Magnetism. https://www.mdpi.com/journal/educationsciences
q2 · i? · associational · r1
Post-hoc Tukey HSD follow-up to the utility ANOVA, reported in the findings section: platforms offering more structured task breakdowns were rated significantly more useful than general conversational LLMs.
"The platforms with higher structured task breakdowns were found to be significantly more useful than general conversational LLMs, according to the post -hoc Tukey HSD tests."
Discussion¶
Related Claims¶
- Epistemic trust in AI-generated content did not differ significantly across the five AI platforms — related
- Exploratory analysis found item difficulty differed across sources, driven by the Google Gemini versus NLE contrast — related
- Student-perceived curricular alignment did not differ between AI and NLE MCQs or among ChatGPT, Gemini and NLE — related
- Distractor distribution did not differ across ChatGPT, Google Gemini and NLE MCQs — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
ai-platform-utility-differs-anova |
title |
Perceived overall utility of generative AI differs significantly across the five platforms used, favoring platforms with structured task breakdowns |
description |
Perceived overall utility of generative AI differs significantly across the five platforms used, favoring platforms with structured task breakdowns |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-12 |
trust |
unverified — no one has confirmed this page's content |
sources |
2 — george-efthimiou-2026, george-efthimiou-2026-2 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.