Claims

Almost half of the studies using simulated learners provide no validity evidence.

Claim · All claims
Evidence · 1 study · review r? · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i? Almost half of the reviewed studies using simulated learners do not provide any evidence of the validity of their models, posing a threat to the reliability of results based on them. → Käser 2023

Evidence

Käser 2023

Käser, T., & Alexandron, G. (2023). Simulated Learners in Educational Technology: A Systematic Literature Review and a Turing-like Test. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-023-00337-2

q2 · i? · review · r?

Review synthesis of validity-assessment practices: the review finds "almost half of the studies using simulated learners do not provide any evidence" of model validity. It warns this "poses a threat to the reliability of results that are based on these models".

"almost half of the studies using simulated learners do not provide any evidence that their modeling addresses the most fundamental question in simulation design - is the model valid?"

Discussion

Page metadata
Field Value
type claim
id simulated-learners-half-no-validity-evidence
title Almost half of the studies using simulated learners provide no validity evidence.
description Almost half of the studies using simulated learners provide no validity evidence.
status review
evidence_strength weak
newest_evidence 2023
generated by process:wiki-ingest on 2026-10-27
trust unverified — no one has confirmed this page's content
sources 1 — käser-2023

Frontmatter is the page's machine-readable record — see the Schema & Guide.