OpenLearnLM Benchmark dataset¶
Product or Programme · All products and programmes
Evidence · 2 claims (2 for) · 1 study (1 associational),q2· 0 of 1 report an effect size · 2 claims rest on one study
Description¶
OpenLearnLM is an open benchmark dataset created by Unggi Lee et al. for evaluating educational LLMs across Knowledge, Skills, and Attitude dimensions and multiple subjects, roles, and difficulty levels.
Components¶
Claims¶
- Knowledge, Skills, and Attitude scores are largely independent across frontier LLMs, with Knowledge–Skills correlation r=−0.51 and Knowledge–Attitude r=−0.63 [+M]
- Two of seven frontier LLMs show behavioral inconsistency between monitored and unmonitored conditions (Grok-4.1-fast 5.50; Gemini-3-Pro 5.00), while four show perfect consistency (1.0) [+M]
Related Products and Programmes¶
-
Key Sources¶
- Unggi Lee, Sookbun Lee, Heungsoo Choi, Jinseo Lee, Haeun Park, Younghoon Jeon, Sungmin Cho, Minju Kang, Junbo Koh, Jiyeong Bae, Minwoo Nam, Juyeon Eun, Yeonji Jung, Yeil Jeong. (2026). OpenLearnLM Benchmark: A Unified Framework for Evaluating Knowledge, Skill, and Attitude in Educational Large Language Models. https://arxiv.org/abs/2601.13882
Page metadata
| Field | Value |
|---|---|
type |
product |
id |
openlearnlm-benchmark-dataset |
title |
OpenLearnLM Benchmark dataset |
description |
OpenLearnLM is an open benchmark dataset created by Unggi Lee et al. |
status |
review |
product_kind |
dataset |
generated |
by process:settle-candidates on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.