Policy and enforcement counts were not strongly associated across systems¶
Claim · All claims
Evidence · 1 study · reviewr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The number of policy labels per study was not significantly associated with the number of enforcement labels by Spearman rank correlation (ρ = .114, p = .283). → Minsun Kim 2026
Evidence¶
Minsun Kim 2026¶
Minsun Kim, S. Moonwara A. Monisha, Zihan Wu, David H. Smith IV. (2026). Exploring the Design Space of LLM-Based Programming Support in CS Education: A Scoping Review through the Lens of Assistance Governance. https://arxiv.org/abs/2607.21257 doi:10.48550/arxiv.2607.21257
q2 · i? · review · r2
Secondary correlational analysis across the 90-system corpus testing whether systems with more policy categories also used more enforcement mechanisms. The CSV data did not support a strong tendency, though many systems used multiple labels of both kinds.
"The number of policy labels per study was not significantly associated with the number of enforcement labels by Spearman rank correlation (ρ=.114,p=.283)."
Discussion¶
Related Claims¶
- Authority over assistance boundaries is highly centralized in system logic in LLM-based programming support systems — related
- Pedagogy and production dimensions associated most strongly with global quality (Spearman ρ = 0.68 and 0.66), while content was relatively independent (ρ = 0.46) — related
- Policy in reviewed systems is commonly expressed as a set of assistance boundaries, concentrated on response constraints, scaffolding, and personalization — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
policy-enforcement-counts-not-associated |
title |
Policy and enforcement counts were not strongly associated across systems |
description |
Policy and enforcement counts were not strongly associated across systems |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — minsun-kim-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.