Solvable judgments of solvability discriminate solvable from unsolvable anagrams even after excluding already-solved judgments¶

Claim · All claims
Evidence · 1 study · causal r3 · q3 · i3 large
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i3 S JOSs discriminate between solvable and unsolvable anagrams above chance even when anagrams that received AS JOSs are excluded from analysis. → Burton 2023

Evidence¶

Burton 2023¶

Burton, O. R., Bodner, G. E., Williamson, P., & Arnold, M. M. (2023). How accurate and predictive are judgments of solvability? Explorations in a two-phase anagram solving paradigm. Metacognition and Learning, 18, 1–35. https://doi.org/10.1007/s11409-022-09313-y

q3 · i3 · causal · r3

Experiment 1 (N = 100 MTurk participants) two-phase anagram paradigm with 16/8/4/2 s durations across four blocks. Repeated-measures ANOVA showed hits exceeded false alarms for AS + S JOSs, η²p = .81 for the discrimination main effect. "averaged across blocks, hits (M = .73, SD = .16) were significantly greater than false alarms".

"Participants’ AS + S JOSs w ere highly discriminating; averaged across blocks, hits (M = .73, SD = .16) w ere significantly greater than false alarms (M = .24, SD = .18)."

Discussion¶

Related Claims¶

• In a self-regulated solving phase, S JOSs predicted solving success and AS and NS JOSs predicted effort regulation — related
• S JOSs were discriminating but not predictive of later solving success in Experiments 1 and 2 — related
• AS and NS JOSs reliably predicted later solving outcomes, with AS JOSs predicting success and NS JOSs predicting failure — related
• Training improved the predictiveness of AS and NS JOSs but not S JOSs, indicating training increased solving during the JOS task rather than JOS predictiveness — related
• Training with longer-duration anagrams improved AS JOS discrimination in blocks 1–3 but not S JOS discrimination — related