Claims

Self-rated LLM familiarity is a weaker secondary intake signal, surviving Holm correction for three of five outcomes with a bottom-anchored pattern

Claim · All claims
Evidence · 1 study (2 entries) · associational r1–r2 · q2 · i2 medium
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i2 Self-rated familiarity survives Holm correction for distinguishing capability (ρ=.294), complex-task trust (ρ=.278), and critical-thinking risk (ρ=−.254), but not for accuracy trust or training interest. → Yongkyung Oh 2026 q2 i? The familiarity pattern is bottom-anchored: separation is clearest at the lower end of the scale while medians for Somewhat and Very familiar groups are often identical. → Yongkyung Oh 2026 (2)

Evidence

Yongkyung Oh 2026

Yongkyung Oh, Lynn Talton, Alex Bui. (2026). Engagement Intensity as a Learner-Modeling Signal for Adaptive AI Ethics Instruction. KDD 2026 AI for Education Day, at the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD '26). https://arxiv.org/abs/2606.18548 doi:10.48550/arxiv.2606.18548

q2 · i2 · associational · r2

Same pre-instruction survey analysis (Spearman correlations, Holm correction across the five-outcome family) in 91 trainees. Printed correlations ρ=.294, ρ=.278, and ρ=−.254 fall in the medium range; accuracy trust (pHolm=.069) and training interest did not survive correction.

"Self-rated familiarity shows a weaker pattern and survives Holm correction for distinguishing capability (𝜌=.294 ,𝑝Holm =.023 ), complex-task trust (𝜌=.278 , 𝑝Holm =.031 ), and critical-thinking risk ( 𝜌=−.254 , 𝑝Holm =.045 )."

Yongkyung Oh 2026 (2)

Yongkyung Oh, Lynn Talton, Alex Bui. (2026). Engagement Intensity as a Learner-Modeling Signal for Adaptive AI Ethics Instruction. KDD 2026 AI for Education Day, at the ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD '26). https://arxiv.org/abs/2606.18548

q2 · i? · associational · r1

Authors' descriptive observation of the median-by-familiarity-level medians in the same survey analysis; the printed Table 2 medians show identical upper-level medians. The article notes the single Not-at-all respondent limits interpretation.

"The familiarity pattern is bottom-anchored rather than smoothly graded. Separation is clearest at the lower end of the scale, while the medians for the “Somewhat familiar” and “Very familiar” groups are often identical."

Discussion

Page metadata
Field Value
type claim
id llm-familiarity-weaker-secondary-intake-signal
title Self-rated LLM familiarity is a weaker secondary intake signal, surviving Holm correction for three of five outcomes with a bottom-anchored pattern
description Self-rated LLM familiarity is a weaker secondary intake signal, surviving Holm correction for three of five outcomes with a bottom-anchored pattern
status review
evidence_strength moderate
newest_evidence 2026
generated by process:wiki-ingest on 2026-10-10
trust unverified — no one has confirmed this page's content
sources 2 — yongkyung-oh-2026, yongkyung-oh-2026-2

Frontmatter is the page's machine-readable record — see the Schema & Guide.