Prototype functionalities moderately encouraged reflection on study goals, but perceived added value was limited and regular use was uncertain¶

Claim · All claims
Evidence · 1 study (2 entries) · design r3 · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Students rated that the prototype's functionalities encouraged thinking and reflecting more on individual study goals at M = 3.58 (SD 1.71), while they were indecisive about regular use (M = 3.1, SD 1.6) and did not always perceive added value (Evaluation functionality M = 2.79, SD 1.6). → Karrenbauer 2023 q2 i? Discussion-level synthesis reports functionalities rated only slightly above satisfaction level (M = 3.0–4.0) and limited perceived added value for certain functionalities (M = 2.70, SD 1.6). → Karrenbauer 2023 (2)

Evidence¶

Karrenbauer 2023¶

Karrenbauer, C., Brauner, T., König, C. M., & Breitner, M. H. (2023). Design, development, and evaluation of an individual digital study assistant for higher education students. Education Tech Research Dev. https://doi.org/10.1007/s11423-023-10255-8

q2 · i? · design · r3

Likert-scale questionnaire item in the functionality "Evaluation" during the 3-month field test. The article also reports "Students were indecisive and could only partly imagine using the IDSA regularly (M = 3.1, /u1D70E = 1.6; R.1.9)" and perceived added value of M = 2.79 (SD 1.6), all descriptive ratings without inferential tests.

"An average of 3.58 showed that the students indicated that the IDSA prototype’s functionalities encouraged them to think and reflect more on their individual study goals (R.1.3; /u1D70E = 1.71)."

Karrenbauer 2023 (2)¶

Karrenbauer, C., Brauner, T., König, C. M., & Breitner, M. H. (2023). Design, development, and evaluation of an individual digital study assistant for higher education students. Education Tech Research Dev. https://doi.org/10.1007/s11423-023-10255-8

q2 · i? · design · r3

Authors' synthesis in the discussion of the field-test questionnaire results, stating functionalities were "rated slightly above the satisfaction level" and that students "only perceived limited added value from certain functionalities".

"Overall, the functionalities of the IDSA prototype were rated slightly above the satisfaction level (M = 3.0–4.0), and students only perceived limited added value from certain functionalities (M = 2.70, /u1D70E = 1.6)."

Discussion¶

Related Claims¶

• Field-tested IDSA prototype received moderate usability ratings: usage enjoyment highest, design and realization lowest — related
• A pilot mixed-method trial with 71 participants found students valued the system along three dimensions: career exploration, personalisation, and skill awareness/self-reflection — related
• Students perceived high learning impact from the personalised GPT agents, with improved conceptual understanding rated highest (mean 4.6, SD 0.5) — reports the opposite