Socrates¶
Product or Programme · All products and programmes
Evidence · 2 claims (1 for, 1 mixed) · 1 study (1 causal),q2· 0 of 1 report an effect size · 2 claims rest on one study
Description¶
Socrates is a playground-and-grader system developed by Xinming Yang et al. for instructors to deploy controlled learning-by-teaching assignments with LLM virtual students in computer science courses.
Components¶
Claims¶
- Running the Socrates playground and grader incurred low cost, with even gpt-4o consuming only $169.90 [+M]
- gpt-4o graded student submissions most correctly in almost all assignments, but gemini-1.0-pro graded the boolean-algebra assignment most correctly [~W]
Related Products and Programmes¶
Key Sources¶
- Xinming Yang, Haasil Pujara, Jun Li. (2025). Learning by Teaching: Engaging Students as Instructors of Large Language Models in Computer Science Education. Published as a conference paper at COLM 2025. https://arxiv.org/abs/2508.05979
Page metadata
| Field | Value |
|---|---|
type |
product |
id |
socrates |
title |
Socrates |
description |
Socrates is a playground-and-grader system developed by Xinming Yang et al. |
status |
review |
product_kind |
software |
generated |
by process:settle-candidates on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.