OpenSciEd lesson-idea dataset of 49 lesson plans and 8820 LLM-simulated student ideas¶
Product or Programme · All products and programmes
Evidence · 3 claims (1 for, 2 mixed) · 1 study (1 design),q2· 0 of 1 report an effect size · 3 claims rest on one study
Description¶
A dataset created by Nguyen et al. containing 49 OpenSciEd science lesson plans with teacher- or pilot-informed student ideas and 8,820 LLM-simulated ideas for studying open-ended science responses.
Components¶
Claims¶
- LLM-simulated student ideas moderately overlap with teacher- and student-generated lesson ideas (mean cosine similarity 0.52), with larger LLMs slightly outperforming Mistral-7B [+M]
- Only 69% of LLM-simulated ideas met the target grade's language level, with elementary grades faring worst and Llama-4 performing best [~W]
- LLM-generated ideas diverge from lesson ideas in grounding, misconception substance, vocabulary, uncertainty markers, and analogy use [~W]
Related Products and Programmes¶
-
Key Sources¶
- Nguyen, H., & Cao, J. (2026). Exploring the Capacity of Large Language Models to Simulate Students' Scientific Thinking: Insights for Responsive Teaching. Journal of Science Education and Technology. https://doi.org/10.1007/s10956-026-10333-5
Page metadata
| Field | Value |
|---|---|
type |
product |
id |
openscied-lesson-idea-dataset-of-49-lesson-plans-and-8820-llm-simulated-student-ideas |
title |
OpenSciEd lesson-idea dataset of 49 lesson plans and 8820 LLM-simulated student ideas |
description |
A dataset created by Nguyen et al. |
status |
review |
product_kind |
dataset |
generated |
by process:settle-candidates on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.