The with/without-tools difficulty gap narrowed as graph size grew, which the authors read as a positive indication of scalability¶

Claim · All claims
Evidence · 1 study · qualitative r? · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The SEQ difference between using and not using the tools decreased from task 3 to tasks 6 and 7 (larger graphs), which the authors interpret as a positive indication of scalability, while some participants expressed mixed sentiment about nev's scalability. → Julián Méndez 2026

Evidence¶

Julián Méndez 2026¶

Julián Méndez, Lukas Gerlach, Tobias Wieland, Alex Ivliev, Markus Krötzsch, Raimund Dachselt. (2026). Evaluating a Visual Query Tracer and Builder for Learning Declarative Logic Programming. arXiv preprint. https://arxiv.org/abs/2607.18864 doi:10.48550/arxiv.2607.18864

q2 · i? · qualitative · r?

Tasks 6 and 7 used larger graphs (100 nodes/444 edges and 500 nodes/2284 edges) to assess scalability; the authors note "a reasonable reduction of the difference can be noted as the graph size increases". This is the authors' interpretation of descriptive data.

"These tasks correspond to the scalability comparison of RQ3, and a reasonable reduction of the difference can be noted as the graph size increases. We interpret these results as a positive indication of the scalability of our approach,"

Discussion¶

Related Claims¶

• Perceived task difficulty with the tools was rated much easier than imagined difficulty without them, with gaps of at least 2.5 SEQ points on every task — related
• A qualitative study with 14 students found very positive perceived task-difficulty and user-experience assessments for the Nemo+nev environment — related