Skip to content

Pair-based, discovery-oriented LLM analysis activity following an eight-week disciplinary module

Design · All designs
Evidence · 2 claims (1 for, 1 mixed) · 1 study (1 qualitative), q2 · 0 of 1 report an effect size · 2 claims rest on one study

Description

The intervention's design combined two pedagogical principles: Vygotsky's Zone of Proximal Development, realized through paired work, and Dewey's learning through experience, realized as an authentic discovery-oriented task without explicit prompt-engineering instruction. Students first completed an eight-week instructional module on text linguistics concepts, then manually analyzed a newspaper article, and finally used an LLM to verify their analysis, creating their own prompts and comparing AI-generated analysis with their own. The authors report that "students completed the assignment in pairs, allowing them to discuss prompting strategies, compare interpretations of LLM outputs, and jointly construct solutions". The activity was part of the course exam program and completed at home over two weeks.

Design Implications

Context

Requirements

  • Prior instructional module building the disciplinary knowledge needed to evaluate LLM outputs
  • access to LLMs via chatbot interfaces

Constraints

  • Without expert scaffolding, students' prompting strategies remained limited, with little use of few-shot prompting or in-context examples

Target Learners

  • undergraduate students in multilingual communication
  • genAI novices

Learning Goals

  • anaphoric relation reconstruction
  • discourse connective analysis
  • critical evaluation of AI-generated outputs

Claims

Examples

-

Key Sources

  • Nicola Brocca, Davide Garassino. (2026). LLMs in text linguistics teaching: an exploratory study with genAI novices in higher education. Computers and Education Open 11 (2026) 100414. https://doi.org/10.1016/j.caeo.2026.100414
Page metadata
Field Value
type design
id pair-based-discovery-llm-analysis-activity
title Pair-based, discovery-oriented LLM analysis activity following an eight-week disciplinary module
description The intervention's design combined two pedagogical principles: Vygotsky's Zone of Proximal Development, realized through paired work, and Dewey's learning through experience, realized as an authentic discovery-oriente...
status review
generated by process:settle-candidates on 2026-10-12
trust unverified — no one has confirmed this page's content
sources 1 — nicola-brocca-2026

Frontmatter is the page's machine-readable record — see the Schema & Guide.