Supervisor experts considered the visualization module more useful than the just-in-time feedback module, but endorsed a revised JIT design after redesign¶

Claim · All claims
Evidence · 1 study (2 entries) · design r2–r3 · q2
Currency · newest study 2016 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In a two-round online survey, eight expert supervisors agreed the VIZ module was more useful than the JIT module feedback. → van der Schaaf 2016 q2 i? After the JIT module was modified in response to critical remarks, all experts strongly agreed with the redesigned personalized just-in-time feedback messages in the second survey round. → van der Schaaf 2016 (2)

Evidence¶

van der Schaaf 2016¶

van der Schaaf, M., Donkers, J., Slof, B., Moonen-van Loon, J., van Tartwijk, J., Driessen, E., Badii, A., Serban, O., Ten Cate, O. (2016). Improving workplace-based assessment and feedback by an E-portfolio enhanced with learning analytics. Education Tech Research Dev. https://doi.org/10.1007/s11423-016-9496-8

q2 · i? · design · r2

Online semi-structured survey in two rounds with eight experts (heads of department or main supervisors of the six participating institutes), assessing digital sketches and mock-ups of the feedback modules; results were analyzed descriptively.

"Findings indicate that the experts reached an agreement that the supervisors considered the VIZ module more useful than the JIT module feedback."

van der Schaaf 2016 (2)¶

van der Schaaf, M., Donkers, J., Slof, B., Moonen-van Loon, J., van Tartwijk, J., Driessen, E., Badii, A., Serban, O., Ten Cate, O. (2016). Improving workplace-based assessment and feedback by an E-portfolio enhanced with learning analytics. Education Tech Research Dev. https://doi.org/10.1007/s11423-016-9496-8

q2 · i? · design · r3

Second survey round using an interactive clickable mock-up after the JIT module was modified (e.g., messages now inform the learner how to reach the next entrustment level, and gaps feedback was added). Experts indicated the feedback "might help to clarify what good performance is for learners".

"In the second round, only the learner just-in-time feedback was surveyed in an interactive clickable mock-up E-portfolio-environment. All the experts strongly agreed with the design of the personalized feedback just-in-time messages in the second round of the survey."

Discussion¶

Related Claims¶

• Students and supervisors in medical, veterinary and teacher education perceived the learning-analytics-enhanced E-portfolio as useful for monitoring professional development — related