The ten-construct instrument showed strong psychometric quality, with the four ARCS dimensions forming a psychometrically sound higher-order motivation construct¶
Claim · All claims
Evidence · 1 study (2 entries) · associationalr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The MGRM-IRT analysis showed strong item discrimination (mean a = 1.91–2.47), excellent fit (CFI = 0.93, TLI = 0.95, RMSEA = 0.001), and marginal reliability of 0.88–0.92. → Xin Tian 2026
q2 i? All four ARCS first-order dimensions loaded strongly on the higher-order motivation construct (outer loadings 0.796–0.828), supporting Keller's multidimensional-yet-unified conceptualization. → Xin Tian 2026 (2)
Evidence¶
Xin Tian 2026¶
Xin Tian, Musa Adekunle Ayanwale, Rethabile Rosemary Molefi, Preeti Manchanda, Nurgün Gençel and Barakat Olabisi Ogunjoun. (2026). Decoding symmetric and asymmetric pathways in generative AI learning adoption: a multi-method study. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-026-00613-w
q2 · i? · associational · r2
Multidimensional graded response IRT calibration on the 842-respondent survey data; the article reports the printed fit indices verbatim, plus item loadings of 0.65–0.88 and marginal reliability coefficients of 0.88–0.92 exceeding the 0.70 benchmark.
"At the global level, the MGRM demonstrated excellent model fit, χ2(2847) = 2816.43, p = 0.655, RMSEA = 0.001 (90% CI [.001, .006]), SRMSR = 0.026, CFI = 0.93, TLI = 0.95."
Xin Tian 2026 (2)¶
Xin Tian, Musa Adekunle Ayanwale, Rethabile Rosemary Molefi, Preeti Manchanda, Nurgün Gençel and Barakat Olabisi Ogunjoun. (2026). Decoding symmetric and asymmetric pathways in generative AI learning adoption: a multi-method study. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-026-00613-w
q2 · i? · associational · r2
Two-stage reflective–reflective PLS-SEM higher-order construct assessment (Table 7) in the same survey; the HOC showed α = 0.829, ρc = 0.886, and AVE = 0.661, which the authors say supports Keller's multidimensional-yet-unified motivation theory.
"all first-order con - structs demonstrated strong loadings on ARCS Motivation, with outer loadings rang - ing from 0.796 to 0.828, exceeding the recommended threshold of 0.70."
Discussion¶
Related Claims¶
- CSEBench items show adequate psychometric quality, with satisfactory difficulty, discrimination, and reliability for both diagnostic forms — related
- The GenAI-SRL scale shows satisfactory reliability, convergent validity, and discriminant validity across its six dimensions — related
- An ACO-derived 12-item short form (GenAI-SRL-12) retains the full scale's factor structure, reliability, and construct equivalence — related
- The GAA-LS shows satisfactory-to-strong internal consistency and evidence of convergent and discriminant validity — related
- CTAT shows robust psychometric properties for higher education CS/AI students, with reliable internal consistency and adequate IRT item parameters — related
- Questionnaire constructs showed acceptable to strong internal consistency (α = 0.740 to 0.945) — related
- The post-interaction reflection instrument showed satisfactory internal consistency (Cronbach's α = .863) — related
- TAILS dimensions show high internal consistency, with Cronbach's alpha values above 0.90 — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
utaut3-arcs-instrument-psychometric-validity |
title |
The ten-construct instrument showed strong psychometric quality, with the four ARCS dimensions forming a psychometrically sound higher-order motivation construct |
description |
The ten-construct instrument showed strong psychometric quality, with the four ARCS dimensions forming a psychometrically sound higher-order motivation construct |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
2 — xin-tian-2026, xin-tian-2026-2 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.