Self-report subscales do not reliably assess distinct metacognitive subcomponents, with structures of two to nine components found across studies¶

Claim · All claims
Evidence · 1 study · quant-synthesis r3 · q3
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2023: tool and model accuracy changes quickly

Subclaims¶

q3 i? The number of subcomponents recovered from self-report measures varied widely across measures and across repeated assessments of the same measure, so no conclusion can be made about assessing distinct subcomponents. → Craig 2020

Evidence¶

Craig 2020¶

Craig, K., Hale, D., Grainger, C., & Stewart, M. E. (2020). Evaluating metacognitive self-reports: systematic reviews of the value of self-report in metacognitive research. Metacognition and Learning, 15, 155-213. https://doi.org/10.1007/s11409-020-09222-y

q3 · i? · quant-synthesis · r3

Systematic review of 22 factor-structure studies. Component analysis "varied widely both across the measures as well as on repeated assessments of the same measure," with "Structures with two, three, four, five, six, eight, and nine components were found (see Table 1)" and no discernable pattern by age.

"Structures with two, three, four, five, six, eight, and nine components were found (see Table 1). Just in the MAI, four, five, six, and eight subcomponents were found."

Discussion¶

Related Claims¶

• Self-report factors correlate weakly with metacognitive behavior while within-factor subcomponent correlations are larger, per studies reviewed for the meta-analysis
• Self-report measures of metacognition support a two-factor structure separating metacognitive knowledge from metacognitive regulation — reports the opposite
• Schellings' questionnaire-thinking-aloud convergent correlation of .51 rests on a small sample and is questionable against other studies — related
• LLM-human factor-structure similarity is consistently lower than human-human similarity on both assessments — related
• The MAKQ dimensions show acceptable internal consistency across both studies (alphas 0.77-0.93) — related