CMS shows acceptable test-retest reliability and internal consistency¶

Claim · All claims
Evidence · 2 studies · 2 design r2 · q2
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2024: tool and model accuracy changes quickly

Subclaims¶

q2 i? Test-retest reliability was acceptable for CMS metacognition (ICC = 0.70) and self-judgment accuracy (ICC = 0.81). → dos Santos Kawata KH 2021 q2 i? Cronbach's alpha values were acceptable for the whole 10 items (α = 0.64), CMS metacognition (α = 0.63), and CMS self-judgment accuracy (α = 0.59). → dos Santos Kawata KH 2021

Evidence¶

dos Santos Kawata KH 2021¶

dos Santos Kawata KH, Ueno Y, Hashimoto R, Yoshino S, Ohta K, Nishida A, Ando S, Nakatani H, Kasai K and Koike S (2021) Development of Metacognition in Adolescence: The Congruency-Based Metacognition Scale. Front. Psychol. 11:565231. https://doi.org/10.3389/fpsyg.2020.565231

q2 · i? · design · r2

Test-retest reliability was assessed with 36 child-parent pairs re-assessed after a mean interval of 58.7 days, using a two-way mixed-effect model with absolute agreement. ICCs were acceptable for both CMS scales.

"The ICC was considered acceptable for the CMS metacognition ( r= 0.70) and for the self-judgment accuracy (r = 0.81), respectively."

dos Santos Kawata KH 2021 (2)¶

dos Santos Kawata KH, Ueno Y, Hashimoto R, Yoshino S, Ohta K, Nishida A, Ando S, Nakatani H, Kasai K and Koike S (2021) Development of Metacognition in Adolescence: The Congruency-Based Metacognition Scale. Front. Psychol. 11:565231. https://doi.org/10.3389/fpsyg.2020.565231

q2 · i? · design · r2

Internal consistency was examined using Cronbach's alpha. Values were acceptable for the whole 10 items and for the five CMS metacognition items; the CMS self-judgment accuracy alpha of 0.59 fell below the 0.6 threshold but the authors note it could be considered satisfactory under another interpretation.

"Cronbach's alpha values were also considered acceptable for the whole 10 items ( α= 0.64) and for the five items of the CMS metacognition ( α= 0.63) and CMS self-judgment accuracy (α= 0.59)."

Discussion¶

Related Claims¶

• The CMS has a one-factor structure with five items for both metacognition and self-judgment accuracy scales — related
• The full survey's test-retest reliability coefficient is 0.79, considered acceptable bordering on good — related
• A 12-item short form of the survey retains acceptable-to-good reliability (alpha = 0.85; test-retest = 0.75) — related
• Self-efficacy measures show high reliability and domain-specific validity — a broader claim this one bears on
• The MAKQ dimensions show acceptable internal consistency across both studies (alphas 0.77-0.93) — related