Feedback questionnaire wording affects LDA topic results, more for emotional value than content¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The share of feedback assigned to Topics 2 and 6 differed notably between academic years with different questionnaires, suggesting the five open-ended questions used in 2017-18 elicited somewhat more positive feedback than the single open-ended question used in 2016-17. → Hujala 2020

Evidence¶

Hujala 2020¶

Hujala, M., Knutas, A., Hynninen, T., & Arminen, H. (2020). Improving the quality of teaching by utilising written student feedback: A streamlined process. Computers & Education. https://doi.org/10.1016/j.compedu.2020.103965

q2 · i? · design · r2

Comparison of the percentage shares of feedback documents assigned to each topic (by highest topic probability) across the two academic years, shown in Figure 4. The authors note the effect "is more pronounced when it comes to the emotional value of the feedback compared to the content of the topics".

"As shown in Figure 4, there is a notable difference in the shares of feedbacks placed into Topics 2 and 6 between the academic years but otherwise the outcomes are almost similar."

Discussion¶

Related Claims¶

• LDA topic modelling of 6,087 written student feedback responses yields six SET-related topics — related
• Thematic analysis of LDA topics identifies six SET themes matching prior literature — related
• LDA topics capture unique information not covered by Likert-scale SET questions — related