PPMC-N detects local dependence in dichotomous IRT models comparably to the Bayesian PPMC approach¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2019 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2022: tool and model accuracy changes quickly

Subclaims¶

q2 i? A simulation study demonstrated that PPMC-N and the Bayesian PPMC approach are comparable in detecting local dependence in dichotomous IRT models. → Megan Kuhfeld 2019

Evidence¶

Megan Kuhfeld 2019¶

Megan Kuhfeld. (2019). A posterior predictive model checking method assuming posterior normality for item response theory. Applied Psychology Measurement 43(2). https://www.nwea.org/research/publication/a-posterior-predictive-model-checking-method-assuming-posterior-normality-for-item-response-theory/ doi:10.1177/0146621618779985

q2 · i? · design · r2

The article's simulation study compared the proposed PPMC-N method against the Bayesian PPMC approach, showing "the comparability of the PPMC-N and the Bayesian PPMC approach" for detecting local dependence in dichotomous IRT models. No effect sizes or test statistics are printed in the available text.

"A simulation study demonstrated the comparability of the PPMC-N and the Bayesian PPMC approach in the detection of local dependence in dichotomous IRT models."

Discussion¶

Related Claims¶

• Bayesian PPMC methods are increasingly used to investigate multidimensionality in IRT models — related
• In operational reading-test data, item parameter estimates from a standard 2PL/GPCM that ignores local dependence closely match those from the testlet model (average correlations 0.9893 and 0.9978) — related
• Ignoring testlet effects by fitting a unidimensional 2PL model produced mild shrinkage of item intercept and loading estimates toward zero relative to the bifactor model — related
• A multidimensional IRT model with simple structure fits testlet-based reading data better than both the general polytomous testlet model and the standard 2PL/GPCM — related
• In operational reading-test data, ignoring local dependence inflates reliability estimates, with passage-based alpha 2.3%-4.9% lower than item-based alpha across six test forms — related