Five design implications for qualitative learning analytics tools: unify creation and extraction, transparent encodings, preserve rare responses, flexible units of analysis, frequency as entry point¶

Strategy · All strategies
Evidence · 1 claim (1 mixed) · 1 study (1 qualitative), q2 · 0 of 1 report an effect size · 1 claim rests on one study

Description¶

The authors translate their integrated findings into five design implications for tools bringing quantitative technique into qualitative learning analytics: enable custom data uploads with insight extraction, make encoding choices transparent and controllable, preserve rare but critical responses, support flexible units of analysis, and use frequency as an entry point instead of an endpoint. They offer these "as suggestions for future WordStream-style and quantitative-based tools rather than as validated solutions". Each pairs participant evidence with a concrete design suggestion.

Design Implications¶

Context¶

Requirements¶

• Further empirical validation, since the implications are grounded in a small purposeful sample

Constraints¶

• Offered as suggestions rather than validated solutions; grounded in a small purposeful sample of ten instructor-researchers analyzing one corpus

Target Learners¶

• STEM instructors who are also qualitative education researchers

Target Learning Goals¶

• Integrating quantitative technique with qualitative analysis of student writing in learning analytics

Claims¶

• Participants held an unresolved epistemological dissensus over whether frequency-based encoding can represent qualitative meaning, ranging from skepticism to enthusiasm [~W]

Related Strategies¶

Examples¶

-

Key Sources¶

• Huyen N. Nguyen, Kathleen A. Bowe, Minh-Huyen Nguyen, Kit Thompson, Caleb M. Trujillo. (2026). Through the WordStream Glass: Revisiting Quantitative Encoding for Qualitative Learning Analytics. arXiv preprint. https://arxiv.org/abs/2606.18692