Claims

Few individuals belong to the common within-person variance model, so traditional reliability indices may mask individual variation

Claim · All claims
Evidence · 1 study · associational r? · q2
Currency · newest study 2021 · checked against its sources 2026-10-09 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2024: tool and model accuracy changes quickly

Subclaims

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i? When individuals are classified via the membership model, few belong to the common variance model, implying traditional reliability indices potentially mask important individual variation. → Donald Williams 2021

Evidence

Donald Williams 2021

Donald Williams, Stephen Martin, Phillipe Rast. (2021). Putting the individual into reliability: Bayesian testing of homogeneous within-person variance in hierarchical models. Behavior Research Methods. https://doi.org/10.3758/s13428-021-01646-x

q2 · i? · associational · r?

Classification analysis using the article's membership model on the cognitive inhibition task data found that "few individuals belong to the common variance model". The article reports no effect size or count for this finding in the available text.

"We also find that few individuals belong to the common variance model, and thus traditional reliability indices are potentially masking important individual variation."

Discussion

Page metadata
Field Value
type claim
id few-individuals-common-variance-model-reliability-masking
title Few individuals belong to the common within-person variance model, so traditional reliability indices may mask individual variation
description Few individuals belong to the common within-person variance model, so traditional reliability indices may mask individual variation
status review
evidence_strength moderate
newest_evidence 2021
source_checked 2026-10-09
recheck_by 2024
generated by process:wiki-ingest on 2026-10-08
trust unverified — no one has confirmed this page's content
sources 1 — donald-williams-2021

Frontmatter is the page's machine-readable record — see the Schema & Guide.