Streamlined four-step process for systematic analysis of written student feedback

Research Method · All research methods
Evidence · 4 claims (4 for) · 1 study (1 design), q2 · 0 of 1 report an effect size · 4 claims rest on one study

Description

The article proposes a repeatable mixed-methods pipeline that "combines text mining to pre-sort the open-ended feedback" with thematic analysis and multilevel modelling. It consists of four main steps: data collection, LDA topic model generation, evaluation of topic-model outcomes (qualitative via thematic analysis and quantitative via multilevel modelling), and reporting. The process is intended for programme- or institution-wide analysis of open-ended feedback rather than for an individual lecturer, and it connects qualitative findings to existing SET literature and quantitative feedback data.

Accounts

• Streamlined four-step process for systematic analysis of written student feedback: The article proposes a repeatable mixed-methods pipeline that "combines text mining to pre-sort the open-ended feedback" with thematic analysis and multilevel modelling. It consists of four main steps: data collection, LDA topic model generation, evaluation of topic-model outcomes (qualitative via thematic analysis and quantitative via multilevel modelling), and reporting. The process is intended for programme- or institution-wide analysis of open-ended feedback rather than for an individual lecturer, and it connects qualitative findings to existing SET literature and quantitative feedback data. (Hujala et al. (2020))

Claims

• LDA topic modelling of 6,087 written student feedback responses yields six SET-related topics [+W]
• Feedback questionnaire wording affects LDA topic results, more for emotional value than content [+W]
• Thematic analysis of LDA topics identifies six SET themes matching prior literature [+W]
• LDA topics capture unique information not covered by Likert-scale SET questions [+W]

Related Research Methods

• Combined topic modelling and thematic analysis for large-scale student-feedback analysis

Key Sources

• Hujala, M., Knutas, A., Hynninen, T., & Arminen, H. (2020). Improving the quality of teaching by utilising written student feedback: A streamlined process. Computers & Education. https://doi.org/10.1016/j.compedu.2020.103965

Page metadata

Field	Value
type	research-method
id	streamlined-four-step-process-for-systematic-analysis-of-written-student-feedback
title	Streamlined four-step process for systematic analysis of written student feedback
description	The article proposes a repeatable mixed-methods pipeline that "combines text mining to pre-sort the open-ended feedback" with thematic analysis and multilevel modelling.
status	review
generated	by process:settle-candidates on 2026-10-30
trust	unverified — no one has confirmed this page's content

Frontmatter is the page's machine-readable record — see the Schema & Guide.