Topic 4 (dissatisfaction with workload) contradicts thematic analysis and appears invalid¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In both academic years, the multilevel regression results for Topic 4 contradicted the thematic analysis: perceived workload was not positively associated with the topic probability of the topic named 'Dissatisfaction with workload', leading the authors to recommend discarding or further investigating that topic. → Hujala 2020

Evidence¶

Hujala 2020¶

Hujala, M., Knutas, A., Hynninen, T., & Arminen, H. (2020). Improving the quality of teaching by utilising written student feedback: A streamlined process. Computers & Education. https://doi.org/10.1016/j.compedu.2020.103965

q2 · i? · design · r2

Multilevel regression analysis of the 2017-18 sample showing that the estimated coefficient for perceived workload on Topic 4's probability was not statistically significant, contradicting the thematic analysis. In the 2016-17 sample the relationship between perceived workload and Topic 4 probability was significantly negative.

"However, despite the name of the topic referring to the workload, the student’s perceived workload is not associated with Topic 4 in the multilevel regression analysis."

Discussion¶

Related Claims¶

• LDA topics capture unique information not covered by Likert-scale SET questions — related
• Likert-scale SET variables predict topic probabilities for most topics in both academic years — related
• Thematic analysis of LDA topics identifies six SET themes matching prior literature — related
• LDA topic modelling of 6,087 written student feedback responses yields six SET-related topics — related