Most Turkish IRT-based scale development studies did not check the unidimensionality or local independence assumptions¶

Claim · All claims
Evidence · 1 study · review r2 · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The unidimensionality assumption was checked in eight studies (42.10%) and the local independence assumption in only six (36.84%) of the reviewed studies. → Kılıç 2023 q2 i? Eight (42.11%) of the reviewed studies examined model-data fit, whereas only 26.32% examined item-fit statistics. → Kılıç 2023

Evidence¶

Kılıç 2023¶

Kılıç, A. F., Koyuncu, İ, & Uysal, İ. (2023). Scale development based on item response theory: A systematic review. International Journal of Psychology and Educational Studies, 10(1), 209-223. https://dx.doi.org/10.52380/ijpes.2023.10.1.982

q2 · i? · review · r2

The review's assumption-check analysis (Table 1) found "the unidimensionality assumption was checked in eight (42.10%), and the local independence assumption was checked in only six (36.84%)" of the reviewed studies; model-data fit was examined in 42.11% and item fit in 26.32%.

"the unidimensionality assumption was checked in eight (42.10%), and the local independence assumption was checked in only six (36.84%)."

Discussion¶

Related Claims¶

• Item and test information functions and marginal reliability were reported by fewer than half of the reviewed studies — related
• The assessment violates IRT assumptions of unidimensionality and local independence, which the authors identify as a likely cause of the method discrepancy — related
• In an empirical comparison on a testlet-based English assessment test, the bifactor model is preferred over the second-order and unidimensional 2PL models by both AIC and BIC — related
• Ignoring testlet effects by fitting a unidimensional 2PL model produced mild shrinkage of item intercept and loading estimates toward zero relative to the bifactor model — related
• Achievement dimensionality appears to change from pretest to end-of-course testing, questioning unidimensional ICC measurement of individual growth during instruction — related
• A multidimensional IRT model with simple structure fits testlet-based reading data better than both the general polytomous testlet model and the standard 2PL/GPCM — related
• Sample sizes in Turkish IRT-based scale development studies ranged from 166 to 2223, with about half below the recommended 500 — related
• Bayesian PPMC methods are increasingly used to investigate multidimensionality in IRT models — related
• Little of the existing IRT scaling and linking expertise from large-scale educational assessment is applied to scaling psychological and social-emotional survey constructs — related
• GLAT shows robust structural validity and reliability under a 2-parameter logistic IRT model — related
• Mokken scale analysis establishes content validity of the ramp task as a unidimensional measure of CVS use
• Psychology has helped develop methods for determining school-system efficiency, including pedagogical retardation statistics and measurement scales — related