Apply metacognitive resolution methodology to assess the accuracy of effort appraisals¶

Strategy · All strategies
Evidence · 2 claims (2 for) · 1 study (1 review), q2 · 0 of 1 report an effect size · 2 claims rest on one study

Description¶

The review recommends applying well-established metacognitive methodologies for studying biases in self-appraisals to investigate effort appraisals. Specifically, it proposes "to determine the covariation of effort appraisals and objective effort measures as an indicator of the resolution of effort appraisals." Resolution is calculated as a within-participant correlation between judgment and objective measure across items, requiring simultaneous administration of both measure types for several items.

Design Implications¶

Context¶

Requirements¶

• Administering subjective and objective effort measures simultaneously for several items
• At least ten items per participant for statistically robust within-participant correlations

Constraints¶

• Objective effort measures lack an absolute minimum and maximum score with clear meaning, precluding calibration

Target Learners¶

• students performing multi-item learning or problem-solving tasks

Target Learning Goals¶

• accurate monitoring of effort investment across varying task demands

Claims¶

• Delayed effort ratings are higher than the average of immediate ratings, suggesting itemized appraisals are more sensitive to effort fluctuations [+W]
• Studies collecting both subjective and objective effort measures reveal dissociations between the two types of measures [+W]

Related Strategies¶

Examples¶

-

Key Sources¶

• Scheiter, K., Ackerman, R., & Hoogerheide, V. (2020). Looking at Mental Effort Appraisals through a Metacognitive Lens: Are they Biased? Educational Psychology Review. https://doi.org/10.1007/s10648-020-09555-9