StudentSimEval

Product or Programme · All products and programmes
Evidence · 3 claims (3 for) · 2 studies (2 design), q2 · 1 of 2 report an effect size · 3 claims rest on one study

Description

StudentSimEval is a benchmark dataset, fixed per-student record schema, held-out evaluation split, and scoring code created by Ke Yang et al. for comparing student-simulator methods on behavioral fidelity and guidance responsiveness.

Components

Claims

• Across chess, L2 writing, and math, trained StudentSim simulators outperform every reference baseline on behavioral fidelity (F) [+M]
• Across all three domains, trained StudentSim simulators outperform every baseline on guidance responsiveness (R), with the largest gap on open-ended guidance modes [+M]
• Mentee fidelity on HSLS:09 test split: attribution transmits far better than decisions, and 98.8% of narrations pass the faithfulness audit [+W]

Related Products and Programmes

-

Key Sources

• Ke Yang, Chenglong Wang, Michel Galley, Chandan Singh, Jeevana Priya Inala, ChengXiang Zhai, Jianfeng Gao. (2026). StudentSim: Training LLM-based Student Simulators. https://arxiv.org/abs/2609.01591

Page metadata

Field	Value
type	product
id	studentsimeval
title	StudentSimEval
description	StudentSimEval is a benchmark dataset, fixed per-student record schema, held-out evaluation split, and scoring code created by Ke Yang et al.
status	review
product_kind	dataset
generated	by process:settle-candidates on 2026-10-11
trust	unverified — no one has confirmed this page's content

Frontmatter is the page's machine-readable record — see the Schema & Guide.