Scripted conversations with recurring task-relevant prompts nearly eliminate observer-rated persona drift, up to a 97% reduction for high-intensity education personas¶
Claim · All claims
Evidence · 1 study · causalr1·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Scripted education conversations showed no detectable observer-rated decline, contrasting with the unscripted decline, with a 97% descriptive reduction in drift for high-intensity personas. → Jana Gonnermann-Müller 2026
Evidence¶
Jana Gonnermann-Müller 2026¶
Jana Gonnermann-Müller, Jennifer Haase, Nicolas Leins, Thomas Kosch, Sebastian Pokutta. (2026). LLM-Based Educational Simulation: Evaluating Temporal Student Persona Stability Across ADHD-Related Persona Specifications. https://arxiv.org/abs/2605.06307 doi:10.48550/arxiv.2605.06307
q2 · i? · causal · r1
Experiment II education scenario comparing scripted versus unscripted conditions across 9-turn conversations. The scripted observer model yielded a non-significant turn effect (β = −0.02, SE = 0.05, t = −0.36, p = .722) with all post-hoc comparisons p = 1.000; the 97% figure is descriptive. No standardized effect size is printed.
"The contrast between unscripted (∆ =−4.0,11 .1%) and scripted (∆ = −0.1,0 .3%) high-intensity education observer ratings is a97%reduction in behavioral drift from conversation structure alone."
Discussion¶
Related Claims¶
- Default personas show a self-report–behavior gap: they endorse moderate-range ADHD characteristics on self-report while displaying only weakly elevated ADHD-like behavior to observers — related
- Between-conversation persona stability is intensity-dependent: high-intensity ADHD personas cluster tightly while moderate-intensity personas show the highest aggregate variability — related
- Observer-rated behavioral expression of high- and moderate-intensity ADHD personas declines progressively across turns in unscripted LLM conversations — related
- LLM-simulated students' self-reported ADHD persona scores remain stable throughout extended multi-turn conversations — related
- Model family and prompt format moderate the level of simulated ADHD persona expression — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
scripted-interaction-eliminates-observer-drift |
title |
Scripted conversations with recurring task-relevant prompts nearly eliminate observer-rated persona drift, up to a 97% reduction for high-intensity education personas |
description |
Scripted conversations with recurring task-relevant prompts nearly eliminate observer-rated persona drift, up to a 97% reduction for high-intensity education personas |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — jana-gonnermann-müller-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.