In an initial eye-tracking study, time on action predicted self-explanation (16-second threshold) and gaze shifts were most reliable at detecting its absence¶

Claim · All claims
Evidence · 1 study (2 entries) · design r2–r3 · q2
Currency · newest study 2005 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2008: tool and model accuracy changes quickly

Subclaims¶

q2 i? Actions accompanied by self-explanation took significantly longer on average than actions without it, and ROC analysis determined 16 seconds as the sufficient-time threshold. → Christina Merten and Cristina Conati 2005 q2 i? Among gaze shifts only, time only, and both combined, gaze shifts proved most reliable at detecting absence of self-explanation, while gaze shifts and time together performed best at identifying self-explanation when it occurred. → Christina Merten and Cristina Conati 2005 (2)

Evidence¶

Christina Merten and Cristina Conati 2005¶

Christina Merten and Cristina Conati. (2005). Eye-Tracking to Model and Adapt to User Meta-cognition in Intelligent Learning Environments. https://www.cs.ubc.ca

q2 · i? · design · r3

User study with 18 university students using ACE with gaze tracked by an Eyelink I eye-tracker; two experts independently coded self-explanation from audio/video, and only fully agreed actions were used, generating 149 data points. ROC analysis set the sufficient-time threshold at 16 seconds.

"We found a statistically significant difference between the average time taken for actions accompanied by self-explanation and actions that were not, indicating that time can be a predictor of self-explanation behavior"

Christina Merten and Cristina Conati 2005 (2)¶

Christina Merten and Cristina Conati. (2005). Eye-Tracking to Model and Adapt to User Meta-cognition in Intelligent Learning Environments. https://www.cs.ubc.ca

q2 · i? · design · r2

In the same 18-student study, three predictors were compared: gaze shifts only, time only, and both combined. Gaze shifts were "the most reliable at detecting the absence of self-explanati on", while gaze shifts and time together were best at identifying self-explanation when it occurred.

"Gaze shifts proved to be the most reliable at detecting the absence of self-explanati on. However, gaze shifts and time performed best together at ide ntifying self- explanation when it occurred."

Discussion¶

Related Claims¶

• Eye tracking can identify which words a second-language reader had trouble understanding
• Adding eye-tracking evidence to ACE's student model significantly improves assessment of implicit self-explanation over a time-only model
• More accurate assessment of self-explanation significantly improves the model's assessment of student learning through exploration
• Time and gaze-shift evidence are complementary predictors of self-explanation: time alone yields higher sensitivity, gaze shifts alone higher specificity, and the combination the best accuracy — related
• Neither self-report nor eye tracking can reliably distinguish strategic from habituated behavior in empirical practice — related
• Leave-one-out cross-validation over 36 students confirms significant accuracy and stability gains from eye-tracking in both self-explanation and exploration assessment — related
• Quality of work rather than time consumed proved the most reliable measure of intelligence across the battery — related