Expert-vetted assessment suite of GUI-oriented vibe-coding tasks with scoring criteria¶
Product or Programme · All products and programmes
Evidence · 2 claims (1 for, 1 mixed) · 3 studies (3 associational),q3· 0 of 3 report an effect size
Description¶
An expert-designed assessment suite of natural-language GUI-oriented vibe-coding tasks with predefined scoring criteria and rubrics, developed by the article's international subject-matter-expert panel for tertiary students.
Components¶
Claims¶
- CS achievement significantly predicts vibe-coding performance and remains a significant predictor after controlling for domain-general cognitive ability [+M] (vibe-coding performance scored with this suite)
- Written-communication skills significantly correlate with vibe-coding performance, but the association does not remain significant after controlling for domain-general cognitive ability [~M]
Related Products and Programmes¶
- Purpose-built no-code vibe-coding research platform for controlled experimentation: the research platform on which the tasks were administered
Key Sources¶
- Sverrir Thorgeirsson, Theo B. Weidmann, and Zhendong Su. 2026. Computer Science Achievement and Writing Skills Predict Vibe Coding Proficiency. Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26). https://doi.org/10.1145/3772318.3791666
Page metadata
| Field | Value |
|---|---|
type |
product |
id |
expert-vetted-assessment-suite-of-gui-oriented-vibe-coding-tasks-with-scoring-criteria |
title |
Expert-vetted assessment suite of GUI-oriented vibe-coding tasks with scoring criteria |
description |
An expert-designed assessment suite of natural-language GUI-oriented vibe-coding tasks with predefined scoring criteria and rubrics, developed by the article's international subject-matter-expert panel for tertiary students. |
status |
review |
product_kind |
assessment |
generated |
by process:settle-candidates on 2026-10-12 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.