In the Reason dimension, the IndoBERT–SVM baseline outperformed all BiLSTM variants, achieving QWK 0.332¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? IB-SVM achieved accuracy 0.522, macro-F1 0.394, and QWK 0.332 in Reason, outperforming all BiLSTM variants. → Firdausi 2026
Evidence¶
Firdausi 2026¶
Firdausi, H.; Wasis; Sholikah, R. W.; Lemantara, J.; Rosyadi, F. D.; Ginardi, R. V. H.; Pradityo, M. H. A.; Hakim, A. R. (2026). Educational Innovation through Automated Essay Scoring: A Multidimensional Framework for Evaluating Critical Thinking in High School Physics Essays. International Journal of Intelligent Engineering and Systems, Vol.19, No.8. https://doi.org/10.22266/ijies2026.0831.09
q2 · i? · design · r2
Test-set comparison across the three architectures in Results §4.3.2. The article reports the SVM with frozen IndoBERT [CLS] embeddings beat every BiLSTM variant on Reason, consistent with kernel models remaining competitive on small domain-specific datasets.
"In the Reason dimension, IB -SVM emerged as the best-performing model, with an accuracy of 0.522, a macro -F1 of 0.394, and a QWK of 0.332 (fair agreement), outperforming all BiLSTM variants."
Discussion¶
Related Claims¶
- The best AES models per FRISCO dimension reached strong agreement for Situation (QWK 0.728) and Clarity (QWK 0.763) but only fair agreement for Focus, Reason, and Inference in Indonesian physics essays — a broader claim this one bears on
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
svm-outperforms-bilstm-reason-dimension |
title |
In the Reason dimension, the IndoBERT–SVM baseline outperformed all BiLSTM variants, achieving QWK 0.332 |
description |
In the Reason dimension, the IndoBERT–SVM baseline outperformed all BiLSTM variants, achieving QWK 0.332 |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
recheck_by |
2029 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — firdausi-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.