Correct final answers are associated with stronger performance on all four process-level metrics, with reasoning-process correctness showing the clearest separation¶
Claim · All claims
Evidence · 1 study · causalr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Correct solutions outperform incorrect solutions on perception, auxiliary quality, utilization, and reasoning for both evaluated models, with the largest deltas in reasoning (46.9 and 53.5 percentage points). → Zhitong Dong 2026
Evidence¶
Zhitong Dong 2026¶
Zhitong Dong, Jicai Pan, Yingguo Gao, Jingting Ding, Hao Chen, Jinjie Gu. (2026). Beyond Generation and Accuracy: Diagnosing and Enhancing Visual Chain-of-Thought for Geometry Problem Solving. arXiv preprint. https://arxiv.org/abs/2609.12606 doi:10.48550/arxiv.2609.12606
q2 · i? · causal · r2
Stage-wise diagnostic comparison of L1-L4 metrics between incorrect and correct solutions (Table 5). The article reports "Correct solutions outperform incorrect solutions on all four process-level metrics"; printed deltas include +46.9 (MathCanvas-7B) and +53.5 (CodePlot-CoT-32B) for reasoning.
"Correct solutions outperform incorrect solutions on all four process-level metrics for both models."
Discussion¶
Related Claims¶
- Four process-level error categories account for roughly nine in ten attributed failures in VCoT geometry solving — related
- Reasoning with ground-truth auxiliary diagrams consistently outperforms reasoning from the original diagram alone on GeoVAD-Bench — related
- GeoWeave-8B achieves the highest open-source final-answer accuracy and process average on GeoVAD-Bench, gaining 25.3 and 30.4 percentage points over its base model — related
- Step-level credit assignment added to Interleave-RL raises the reasoning score from 46.3% to 66.3% on GeoVAD-Bench — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
process-metrics-separate-correct-incorrect-solutions |
title |
Correct final answers are associated with stronger performance on all four process-level metrics, with reasoning-process correctness showing the clearest separation |
description |
Correct final answers are associated with stronger performance on all four process-level metrics, with reasoning-process correctness showing the clearest separation |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — zhitong-dong-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.