LLMs support the shift from memorization-focused to competency-based assessment by generating rubrics, varied assessment items and authentic scenario-based tasks¶

Claim · All claims
Evidence · 1 study (2 entries) · review r2 · q2
Currency · newest study 2025 · checked against its sources 2026-10-18 (automated, 2 of 2 entries) · not reviewed by a person

Subclaims¶

q2 i? The reviewed studies indicate LLMs help educators develop criteria and rubrics aligned with disciplinary learning outcomes and produce varied assessment items tailored to course objectives. → Martínez-Peláez 2025 q2 i? By simulating authentic work-related or ethical situations, LLMs let students showcase applied skills and decision-making, shifting assessment emphasis from factual recall to analysis, creativity and critical thinking. → Martínez-Peláez 2025 (2)

Evidence¶

Martínez-Peláez 2025¶

Martínez-Peláez, R.; Mena, L.J.; Toral-Cruz, H.; Ochoa-Brust, A.; Potes, A.G.; Flores, V.; Ostos, R.; Ramírez Pacheco, J.C.; Félix, R.A.; Félix, V.G. (2025). Can Large Language Models Foster Critical Thinking, Teamwork, and Problem-Solving Skills in Higher Education?: A Literature Review. Systems 2025, 13, 1013. https://doi.org/10.3390/systems13111013

q2 · i? · review · r2

The review's RQ4 synthesis reports generative abilities enable production of "a wide variety of assessment items, including open-ended, multiple-choice, and reasoning questions" tailored to specific course objectives and contexts. No effect sizes are printed.

"LLMs can help educators develop criteria and rubrics that align with disciplinary learning outcomes and professional standards"

Martínez-Peláez 2025 (2)¶

Martínez-Peláez, R.; Mena, L.J.; Toral-Cruz, H.; Ochoa-Brust, A.; Potes, A.G.; Flores, V.; Ostos, R.; Ramírez Pacheco, J.C.; Félix, R.A.; Félix, V.G. (2025). Can Large Language Models Foster Critical Thinking, Teamwork, and Problem-Solving Skills in Higher Education?: A Literature Review. Systems 2025, 13, 1013. https://doi.org/10.3390/systems13111013

q2 · i? · review · r?

The review's RQ4 synthesis states this is particularly valuable in fields such as engineering, health care and business, and that immediate feedback and adaptive testing can enhance formative assessment practices. No effect sizes are printed.

"By simulating authentic work-related or ethical situations, LLMs allow students to showcase applied skills and decision-making in realistic settings"

Discussion¶

Related Claims¶

• LLMs help bridge the gap between theoretical curricula and real-world skills by creating simulated scenarios, cases and problem contexts that are hard to reproduce in traditional classrooms — related
• The Bloom-driven framework generalizes to social-science questions, with automated rubrics agreeing strongly with experts on usability but only modestly on Bloom level — related
• Disciplinary AI interaction competencies are observable in student response artifacts and scorable with rubrics grounded in student data and expert knowledge — related
• Preparing for oral assessments changes student study habits toward understanding over memorization — related
• Authentic assessment designs in higher education predominantly replicate professional workplace scenarios, with few addressing social authenticity — related
• Prompt quality and detailed scoring rubrics significantly influence the accuracy and consistency of LLM-generated grades — related