Pragmatic complexity–difficulty distinction for well-structured learning items

Research Method · All research methods
Evidence · 2 claims (2 for) · 1 study (1 associational), q2 · 0 of 1 report an effect size · 2 claims rest on one study

Description

The article proposes a pragmatic distinction between complexity and difficulty measures for well-structured problems in learning systems: "a complexity measure is based only on the item description, it does not use any data about student performance; a difficulty measure is based only on data about student performance". Complexity is "an intrinsic item characteristic" concerned with the structure of the item, while difficulty describes how hard the item is for students. The authors acknowledge that context, biases, and scaffoldings make the distinction "more convoluted", so measures "end up lying on a spectrum rather than at two clear poles".

Accounts

• Pragmatic distinction between complexity and difficulty measures based on data source: The article proposes a pragmatic distinction between complexity and difficulty measures for well-structured problems in learning systems: "a complexity measure is based only on the item description, it does not use any data about student performance; a difficulty measure is based only on data about student performance". Complexity is "an intrinsic item characteristic" concerned with the structure of the item, while difficulty describes how hard the item is for students. The authors acknowledge that context, biases, and scaffoldings make the distinction "more convoluted", so measures "end up lying on a spectrum rather than at two clear poles". (Pelánek et al. (2022))

Claims

• Shallow complexity measures for word problems correlate only weakly with difficulty [+W]
• Complexity measures for logic puzzles vary in correlation with difficulty across puzzle types [+W]

Related Research Methods

-

Key Sources

• Pelánek, R., Effenberger, T., & Čechák, J. (2022). Complexity and Difficulty of Items in Learning Systems. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-021-00252-4

Page metadata

Field	Value
type	research-method
id	pragmatic-complexitydifficulty-distinction-for-well-structured-learning-items
title	Pragmatic complexity–difficulty distinction for well-structured learning items
description	The article proposes a pragmatic distinction between complexity and difficulty measures for well-structured problems in learning systems: "a complexity measure is based only on the item description, it does not use any data about student performance; a difficulty measure is based only on data about
status	review
generated	by process:settle-candidates on 2026-10-28
trust	unverified — no one has confirmed this page's content

Frontmatter is the page's machine-readable record — see the Schema & Guide.