Neither self-report nor eye tracking can reliably distinguish strategic from habituated behavior in empirical practice¶

Claim · All claims
Evidence · 1 study · theoretical r3 · q1
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2020: tool and model accuracy changes quickly

Subclaims¶

q1 i? In empirical practice, researchers cannot reliably determine whether observed behavior reflects intentionality and effortfulness of strategies or habituated, cognitively effortless skills, since even eye tracking cannot reliably make this distinction. → Patricia A. Alexander 2017

Evidence¶

Patricia A. Alexander 2017¶

Patricia A. Alexander. (2017). Issues of Constructs, Contexts, and Continuity: Commentary on Learning in Higher Education. Educational Psychology Review, 29, 345–351. https://doi.org/10.1007/s10648-017-9409-3

q1 · i? · theoretical · r3

Theoretical argument in the commentary about measurement limits: relying on self-report "cannot illuminate those differences in compelling or convincing ways," and "Even data-capture techniques like eye tracking cannot reliably tell" whether behavior was habituated or planned. Researchers are left to presume strategic behavior. No empirical test is offered.

"Even data-capture techniques like eye tracking cannot reliably tell whether the documented behavior represented the learners'habituated actions or some planned maneuver."

Discussion¶

Related Claims¶

• Zusho concludes SRL, SAL, and engagement perspectives all entail learner adaptation, and that models of student learning mismatch how they are measured
• Dinsmore's review of 134 studies argues that models of strategic processing among college students must be multidimensional and dynamic
• Mobile eye tracking distinguishes five document types with 99 percent user-dependent and 74 percent user-independent recognition from about one minute of gaze data
• In an initial eye-tracking study, time on action predicted self-explanation (16-second threshold) and gaze shifts were most reliable at detecting its absence — related
• Task difficulty shows a u-shaped relation to regulatory activities, with competing CLT-based and motivational explanations that cannot yet be distinguished — related
• Review findings on college strategic processing: development under-studied, quality of strategy use matters more than frequency, and learner and environmental conditions determine effectiveness — related
• Repeated reflective prompts may habituate, so scaffolding can replace rather than strengthen the user's own metacognitive habits — related
• Engagement inferred from log data must be treated with caution because digital traces reflect unevenly distributed social and material conditions — related
• Overall validity of eye-tracking measures of learning in IVR is limited, averaging 1.93 of 4, with data quality the weakest component — related
• Longer eye fixation time is ambiguous between processing difficulty and extra processing effort, so eye movement data should be validated with outcome measures — a narrower finding that bears on this claim
• University students adapt their behavioral processing of discrepant science content as a function of their epistemic cognition and discrepancy type — related