Ablations show removing the strategy selector substantially increases leakage and replacing the NLI verifier with same-model self-check reduces performance¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q2 i? Removing the strategy selector substantially increases leakage, and replacing the NLI verifier with same-model self-check reduces performance, showing that architectural separation matters. → S M Asif Hossain 2026

Evidence¶

S M Asif Hossain 2026¶

S M Asif Hossain, Ruksat Khan Shayoni, M. F. Mridha, and Jungpil Shin. (2026). EduGuard: A Safe RAG-Based LLM Tutor for Programming Education. arXiv preprint arXiv:2607.15738. https://arxiv.org/abs/2607.15738 doi:10.48550/arxiv.2607.15738

q2 · i? · design · r2

Ablation study on BILearn-CS reported in Table 5; the article also reports that removing the verifier nearly doubles hallucination and gives the no-strategy-selector variant the highest leakage of the ablations. The same-model verifier variant underperforms the full pipeline.

"Removing the strategy selector substantially increases leakage. Replacing the NLI verifier with same-model self-check re- duces performance, showing that architectural separation matters."

Discussion¶

Related Claims¶

• Ablations show the semi-Markov controller is the primary driver of behavioral fidelity (removal pushes DKL to 6.81) and Strategist/Executor separation is essential for epistemic fidelity and realism — related
• Each SRJudge component contributes: the Reasoner and Judger add measurable F1 gains over the Selector alone — related