In the CRT experiment, response time served as a significantly stronger cue for goal-driven effort, data-driven effort, and difficulty appraisals than for confidence appraisals¶
Claim · All claims
Evidence · 1 study · causalr2·q3·i3large
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i3 In experiment 1 (CRT), the appraisal-response time correlation was significantly weaker for confidence than for each of the three load-related appraisal types (η2 = 0.15). → Emely Hoch 2023
Evidence¶
Emely Hoch 2023¶
Emely Hoch, Yael Sidi, Rakefet Ackerman, Vincent Hoogerheide, Katharina Scheiter. (2023). Comparing Mental Effort, Difficulty, and Confidence Appraisals in Problem-Solving: A Metacognitive Perspective. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09779-5
q3 · i3 · causal · r2
Online experiment with 284 Prolific participants solving 17 CRT items, randomly assigned to goal-driven effort, data-driven effort, difficulty, or confidence appraisal groups. ANOVA on within-participant appraisal-response time correlations showed a "significant large effect of appraisal type" with η2=0.15, confidence weaker than all three load-related appraisals (all ps < 0.001).
"There was a significant large effect of appraisal type, F(3, 280) = 16.93, MSE = 0.09, p< 0.001, η2=0.15. Post hoc pairwise comparisons (t-tests with Bonferroni adjustment for p-values) showed that the correlation with response time was significantly weaker for confidence than for each of the other three appraisal types"
Discussion¶
Related Claims¶
- In the CRT experiment, confidence appraisals predicted solving accuracy more strongly than goal-driven effort appraisals — related
- Averaged across three experiments, load-related appraisals correlated more strongly with response time than confidence did, while difficulty and confidence predicted accuracy more strongly than mental effort appraisals — a broader claim this one bears on
- In the non-verbal MTT experiment, response time served as a cue for goal-driven effort appraisals more than for confidence appraisals, partly replicating experiment 1 — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
rt-cue-stronger-for-load-appraisals-than-confidence-crt |
title |
In the CRT experiment, response time served as a significantly stronger cue for goal-driven effort, data-driven effort, and difficulty appraisals than for confidence appraisals |
description |
In the CRT experiment, response time served as a significantly stronger cue for goal-driven effort, data-driven effort, and difficulty appraisals than for confidence appraisals |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2023 |
generated |
by process:wiki-ingest on 2026-10-22 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — emely-hoch-2023 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.