Students rated all student-facing design principles positively, with formative assessment and learning content rated highest (above 6 on a 7-point scale)¶

Claim · All claims
Evidence · 1 study (2 entries) · design r2 · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In the end-of-term survey, all items corresponding to design principles averaged above 4.0 on a +1 to +7 Likert scale; DP4 (automatic evaluation and feedback, ø 6.26) and DP5 (provision of files, ø 6.20) reached the highest values. → Sebastian Hobert 2023 q2 i? Time independence (ø 5.99) was rated substantially more important than location independence (ø 4.99), and organizational question answering (ø 5.22) was rated lower than explaining learning objects (ø 5.93) and proactive suggestions (ø 5.87). → Sebastian Hobert 2023 (2)

Evidence¶

Sebastian Hobert 2023¶

Sebastian Hobert, Florian Berens. (2023). Developing a digital tutor as an intermediary between students, teaching assistants, and lecturers. Education Tech Research Dev. https://doi.org/10.1007/s11423-023-10293-2

q2 · i? · design · r2

Quantitative survey of the design principles administered at the last lecture; approximately 270 students attended and 176 filled out the questionnaire. All design-principle items averaged above 4.0, with "Automatic evalua/g415on and feedback" at ø 6.26 and "Provision of files" at ø 6.20 the highest-rated items in Table 1.

"Overall, the quantitative results show that the students rated all items corresponding to design principles on average positively (i.e., larger than 4.0 on a Likert scale ranging from + 1 (strongly disagree) to + 7 (strongly agree))"

Sebastian Hobert 2023 (2)¶

Sebastian Hobert, Florian Berens. (2023). Developing a digital tutor as an intermediary between students, teaching assistants, and lecturers. Education Tech Research Dev. https://doi.org/10.1007/s11423-023-10293-2

q2 · i? · design · r2

Same end-of-term survey (176 respondents). The article contrasts the two DP2 sub-items, noting location independence (ø 4.99) was rated lower than time independence (ø 5.99), and separately that organizational questions (ø 5.22) scored below learning-related answers (ø 5.93) and suggestions (ø 5.87).

"However, location independence was rated substantially less important than time independence (ø 4.99 vs. ø 5.99)."

Discussion¶

Related Claims¶

• Students reported positive usability and acceptance of MentorChat — related
• Students rated ChatGPT highly for completing activities more quickly, among the highest-scoring survey items in both courses — related
• Undergraduate learners rated CyberAGENTS positively, with scenario authenticity highest and challenge difficulty alignment lowest — related
• Students rated the flipped-learning component highest and the GenAI module lower, with GenAI rated stronger for ideation than for time saving or direct output use — related
• Qualitative interviews with 23 students support the survey results, indicating the digital tutor supported students' learning processes — a narrower finding that bears on this claim