CCM showed adequate model-data fit for game log data, except for infrequent tasks 7 and 9¶
Claim · All claims
Evidence · 1 study (2 entries) · designr2·q3
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2025: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Observed total scores were similar to model-implied total scores, suggesting the CCM can fit the data. → Jiaqi Yu 2022
q3 i? Weighted and unweighted MAD values were less than .25 except those related to tasks 7 and 9. → Jiaqi Yu 2022 (2)
Evidence¶
Jiaqi Yu 2022¶
Jiaqi Yu, Wenchao Ma, Jewoong Moon, Andre R. Denham. (2022). Developing a Stealth Assessment System Using a Continuous Conjunctive Model. Journal of Learning Analytics, 9(3), 11–31. https://doi.org/10.18608/jla.2022.7639
q3 · i? · design · r2
Internal model evaluation comparing histogram of observed total scores with density plot of model-implied total scores (Figure 5). "The observed and model-implied total scores are similar, suggesting that the model can fit data."
"The observed and model-implied total scores are similar, suggesting that the model can fit data."
Jiaqi Yu 2022 (2)¶
Jiaqi Yu, Wenchao Ma, Jewoong Moon, Andre R. Denham. (2022). Developing a Stealth Assessment System Using a Continuous Conjunctive Model. Journal of Learning Analytics, 9(3), 11–31. https://doi.org/10.18608/jla.2022.7639
q3 · i? · design · r2
Weighted and unweighted mean absolute deviation computed per task for both halves. "all values were less than .25, except those related to tasks 7 and 9" — task 7 unweighted MAD was 0.34 and 0.36 in the two halves.
"The values of MAD are on a scale of 0 to 1 and all values were less than .25, except those related to tasks 7 and 9, suggesting that the model can fit most data adequately."
Discussion¶
Related Claims¶
- CCM-estimated skill profiles showed minor positive correlations with external pre- and post-test scores, ranging from .018 to .495 — related
- Standard BKT fits Raging Skies pilot process data with acceptable RMSE and good accuracy under 10-fold cross-validation — related
- Automated detectors of disengaged behaviors inferred from interaction-log data alone reached AUC over 0.8 for gaming and correlated 0.55 with observed off-task behavior — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
ccm-model-data-fit-adequate-except-tasks-7-9 |
title |
CCM showed adequate model-data fit for game log data, except for infrequent tasks 7 and 9 |
description |
CCM showed adequate model-data fit for game log data, except for infrequent tasks 7 and 9 |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2022 |
recheck_by |
2025 |
generated |
by process:wiki-ingest on 2026-10-09 |
trust |
unverified — no one has confirmed this page's content |
sources |
2 — jiaqi-yu-2022, jiaqi-yu-2022-2 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.