Undergraduate learners rated CyberAGENTS positively, with scenario authenticity highest and challenge difficulty alignment lowest¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? In a classroom deployment, undergraduate participants rated scenario authenticity highest (M = 4.21) and challenge difficulty alignment lowest (M = 3.12) on 5-point Likert items. → Hornung 2026
Evidence¶
Hornung 2026¶
Hornung, I., Marasinghe Arachchige, D., Kumarage, T., Agrawal, G., Deng, Y., Chen, Y.-C., & Liu, H. (2026). CyberAGENTS: Structured Autonomy for Agentic Gamified Learning in Cybersecurity. Preprint. https://arxiv.org/abs/2608.07965 doi:10.48550/arxiv.2608.07965
q2 · i? · design · r2
Classroom deployment with 24 undergraduate students using a within-subjects design; each participant completed one interactive cybersecurity scenario with the full agent loop and a mixed-format post-study survey. Descriptive Likert statistics show "scenario authenticity (M = 4.21, SD = 0.88)" as highest rated; no inferential tests or effect sizes are reported.
"The highest-rated dimension was scenario authenticity (M = 4.21, SD = 0.88), followed by gamification impact (M = 3.96, SD = 1.11), trust in system feedback (M = 3.92, SD = 1.18)"
Discussion¶
Related Claims¶
- Open-ended learner feedback revealed four themes: trust in AI scaffolding, feedback clarity, engagement, and task authenticity — related
- Students expressed positive overall opinions of GBSRI, rating Independent Practicing highest and Post-writing lowest — related
- Students rated ChatGPT highly for completing activities more quickly, among the highest-scoring survey items in both courses — related
- IMI motivation ratings after four weeks of Mangomon play were moderate (all sub-scale means below 4.00), highest for effort/importance and lowest for perceived choice — related
- A design-based study with 42 undergraduates reported a 15% improvement in rubric alignment and faster correction cycles from proactive agentic feedback loops — related
- Easier items were perceived as better aligned with the curriculum (strong difficulty–alignment association)
- Activity-Technology alignment is the weakest quality dimension across all agents (mean = 2.19), identifying technology integration as a universal challenge — related
- Students rate LLM-generated simplified instructions positively, averaging 7.83 on a 1-10 usefulness scale across 42 ratings in a live cybersecurity course — related
- Students rated DPs positively, did not distinguish the two LLMs, and disagreed with experts on the same DPs, rating feasibility significantly lower — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
cyberagents-positive-learner-perceptions |
title |
Undergraduate learners rated CyberAGENTS positively, with scenario authenticity highest and challenge difficulty alignment lowest |
description |
Undergraduate learners rated CyberAGENTS positively, with scenario authenticity highest and challenge difficulty alignment lowest |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
source_checked |
2026-10-20 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — hornung-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.