Physiological measures have limited validity for effort, especially for distinguishing data-driven from goal-driven effort¶

Claim · All claims
Evidence · 1 study (2 entries) · theoretical r2–r3 · q1–q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q2 i? Physiological measures show some validity for data-driven effort but vary in detecting subtle task-difficulty changes, and subjective ratings appear to have the best validity. → Katharina Scheiter 2025 q1 i? Physiological measures are unlikely to distinguish data-driven from goal-driven effort because all assess global processing activity. → Katharina Scheiter 2025 (2)

Evidence¶

Katharina Scheiter 2025¶

Katharina Scheiter. (2025). Commentary: How can We Come to Terms when Discussing the Role of Effort from the Perspective of Cognitive Load Theory and Theories of Self-regulated Learning? Educational Psychology Review. https://doi.org/10.1007/s10648-025-10037-z

q2 · i? · theoretical · r3

The commentary reports, citing Ayres et al. (2021), that physiological measures (pupillometry, skin conductance, heart rate, brain measures) have some validity for data-driven effort but vary in sensitivity, with subjective ratings showing the best validity.

"Ayres et al. (2021) showed that while these measures have some validity with respect to measuring data-driven effort (i.e., consequences of varying task difficulty), they strongly vary in their ability to detect subtle changes in task difficulty. Subjective ratings appear to have the best validity."

Katharina Scheiter 2025 (2)¶

Katharina Scheiter. (2025). Commentary: How can We Come to Terms when Discussing the Role of Effort from the Perspective of Cognitive Load Theory and Theories of Self-regulated Learning? Educational Psychology Review. https://doi.org/10.1007/s10648-025-10037-z

q1 · i? · theoretical · r2

Theoretical argument in the commentary: the same physiological indicators would be used for two constructs that differ at the psychological level, and validity of subjective versus objective goal-driven effort measures may depend on task enjoyment.

"it seems unlikely that physiological measures can be used to distinguish between data-driven and goal-driven effort as all of them assess global processing activity"

Discussion¶

Related Claims¶

• Confirmatory physiological tests found no significant tool×task interactions for pupil Δ or ln RMSSD, with substantial data loss limiting interpretation — related
• Perceived task difficulty ratings show a strong relation to Rasch-estimated relative task difficulty, supporting construct validity of the single-item scale — related
• Effort measurement type moderates the correlation: self-agency ratings show a positive association and subjective ratings a stronger negative one than objective measures — related
• Skin conductance level did not differ significantly between instructor-presence conditions, though arousal patterns appeared to vary with content difficulty — a narrower finding that bears on this claim
• Current cognitive load measures cannot detect overload because the critical level indicating overload is unknown — related
• Self-reported mental effort increased less across tasks in the ChatGPT condition while perceived difficulty rose equally in both groups — related
• Effort investment is driven differently in CLT (data-driven, task difficulty) versus SRL theories (goal-driven, motivation) — a broader claim this one bears on
• Studies collecting both subjective and objective effort measures reveal dissociations between the two types of measures — related
• Subjective symptoms are an unreliable measure of fatigue, and physiological tests have not yet yielded a reliable measurement method (Offner) — reports the opposite