Easier items were perceived as better aligned with the curriculum (strong difficulty–alignment association)¶

Claim · All claims
Evidence · 1 study · associational r1 · q3 · i3 large
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i3 Item difficulty and student-perceived curricular alignment showed a strong association: easier items were seen as better aligned. → Vogt P 2026

Evidence¶

Vogt P 2026¶

Vogt P, Wolf N, Jordan S, Volz-Willems S, Jäger J, Dupont F. (2026). Can students identify AI? – A cross-sectional quantitative study about AI recognition in tablet-based MCQ assessment among fifth-year undergraduate medical students at Saarland University, Germany. BMC Medical Education. https://doi.org/10.1186/s12909-026-10410-8

q3 · i3 · associational · r1

Spearman correlation between item difficulty index and student-perceived curricular alignment across exam items. The article reports "a strong association" with ρ = 0.762, p < 0.001 in both directions; 66% of ratings indicated alignment overall.

"Item difficulty and perceived alignment showed a strong association; easier items were seen as better aligned (ρ = 0.762, p < 0.001) and items with higher difficulty were perceived as “not aligned” (ρ = —0.762, p < 0.001)."

Discussion¶

Related Claims¶

• Undergraduate learners rated CyberAGENTS positively, with scenario authenticity highest and challenge difficulty alignment lowest
• Student-perceived curricular alignment did not differ between AI and NLE MCQs or among ChatGPT, Gemini and NLE — related
• Perceived task difficulty ratings show a strong relation to Rasch-estimated relative task difficulty, supporting construct validity of the single-item scale — related
• Students show the highest learning gains in classes that are both challenging and where students actually do work aligned with teachers' expectations; grades are higher in challenging classrooms with high support than in easier classrooms with little support — related