The article constructs an educational benchmark of 108 instruction instances grouped into simple, composite, and complex difficulty levels¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The constructed educational benchmark contains 108 instances split evenly across simple, composite, and complex difficulty labels, each pairing a natural language command with generated Python code. → Shenqi Lu and Liangwei Zhang 2026

Evidence¶

Shenqi Lu and Liangwei Zhang 2026¶

Shenqi Lu and Liangwei Zhang. (2026). EduSim-LLM: An Educational Platform Integrating Large Language Models and Robotic Simulation for Beginners. https://arxiv.org/abs/2601.01196 doi:10.48550/arxiv.2601.01196

q2 · i? · design · r2

Benchmark construction described in Section 3.2: "The test set contains 108 instances, including 36 simple, 36 composite, and 36 complex instructions." Table 1 lists each difficulty level's definition and evaluation indicators (success rate, failure reasons).

"The test set contains 108 instances, including 36 simple, 36 composite, and 36 complex instructions. Each instance consists of a natural language command, the Python control code generated by the LLM, and a difficulty label."

Discussion¶

Related Claims¶

• LLM-generated robot control code succeeds on 100%, 94.4%, and 88.9% of simple, composite, and complex instructions respectively — related
• A single natural-language command can be decomposed by an LLM into coordinated sequential action sequences for multiple robots — related