Mathematics performance is positively correlated with metacognitive resolution in multiple-choice testing across six experiments¶

Claim · All claims
Evidence · 1 study · causal r? · q3
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Across six multiple-choice mathematics experiments, the correlation between proportion correct and resolution metrics was positive and significant for ROC-based metrics in every experiment. → Vuorre 2021

Evidence¶

Vuorre 2021¶

Vuorre, M., & Metcalfe, J. (2021). Measures of relative metacognitive accuracy are confounded with task performance in tasks that permit guessing. Metacognition and Learning. https://doi.org/10.1007/s11409-020-09257-1

q3 · i? · causal · r?

Reanalysis of six experiments (1A-F) with middle school and undergraduate samples completing four-alternative multiple-choice mathematics tests with confidence ratings. Kendall's tau correlations between proportion correct and resolution metrics were positive; e.g. da tau = 0.26 (p < 0.001) in 1A rising to 0.46 (p < 0.001) in 1F. The "correlation was positive and significant for every experiment for both ROC based metrics".

"As can be seen in Table 2, the correlation was positive and significant for every experiment for both ROC based metrics, and significant (or marginally so) for four out of six experiments for the concordant-discordant pairs gamma."

Discussion¶

Related Claims¶

• Performance-resolution correlation is significant in 2AFC but much smaller and mostly non-significant in free-response testing — related
• Observed performance-resolution slopes in the mathematics data were not greater than those produced by guessing in simulation — reports the opposite
• In simulations, resolution metrics become strongly positively related to knowledge once guessing is possible, even when true resolution is constant — related
• Metacognitive strategies correlate strongly with problem-solving skills, and behavioural metrics correlate with task performance — related