ISD-Agent-Bench¶
Product or Programme · All products and programmes
Evidence · 3 claims (2 for, 1 mixed) · 1 study (1 causal),q2· 1 of 1 report an effect size · 3 claims rest on one study
Description¶
ISD-Agent-Bench is a benchmark dataset and evaluation harness created by YoungHoon Jeon et al. for assessing LLM agents across instructional-systems-design scenarios using ADDIE-based rubrics and trajectory evaluation.
Components¶
Claims¶
- React-ADDIE, integrating the ADDIE framework with ReAct-style reasoning, achieves the highest benchmark performance (86.49), outperforming pure theory-based agents and technique-only baselines [+M]
- Theoretical quality of agent outputs strongly correlates with benchmark performance (r = 0.656) [+M]
- Theoretical quality of both theory-based and non-theory agents remains stable across Easy, Medium, and Hard scenario difficulty levels [~W]
Related Products and Programmes¶
Key Sources¶
- YoungHoon Jeon, Suwan Kim, Haein Son, Sookbun Lee, Yeil Jeong, Unggi Lee. (2026). ISD-Agent-Bench: A Comprehensive Benchmark for Evaluating LLM-based Instructional Design Agents. Preprint. https://arxiv.org/abs/2602.10620
Page metadata
| Field | Value |
|---|---|
type |
product |
id |
isd-agent-bench |
title |
ISD-Agent-Bench |
description |
ISD-Agent-Bench is a benchmark dataset and evaluation harness created by YoungHoon Jeon et al. |
status |
review |
product_kind |
dataset |
generated |
by process:settle-candidates on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.