The relationship between keystroke data and writing quality may be less clear than previously posited¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In contrast to previous studies reporting strong process–quality relations, this study found the relationship between writing quality and keystroke data was rather limited. → Rianne Conijn 2022

Evidence¶

Rianne Conijn 2022¶

Rianne Conijn, Christine Cook, Menno van Zaanen, Luuk Van Waes. (2022). Early prediction of writing quality using keystroke logging. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-021-00268-w

q2 · i? · associational · r2

Abstract-level summary of the study's three analyses (correlational, regression, classification) on the 126-student ESL summarization dataset; it restates the null regression and near-null classification findings detailed in Results. No effect size printed.

"The results show that, in contrast to previous work, the relationship between writing quality and keystroke data was rather limited. None of the regression models outperformed the baseline, and the classification models were only slightly better than the majority class baseline (highest AUC = 0.57)."

Discussion¶

Related Claims¶

• Binary classification of students who might need support from keystroke data only slightly exceeds the majority-class baseline (highest AUC 0.57) — related
• Over the full writing process, only one of 54 keystroke features (percentage of long pauses between words) correlates significantly with final writing grade in ESL academic summaries — a narrower finding that bears on this claim
• Which keystroke features correlate with writing grade changes across stages of the writing process: pause-variance and focus-shift features matter early, sentence-transition and event features later — related