Claims

On the live single-node deployment, short-answer rounds take ≈32 s (≈$0.015/round) while multiple-choice rounds are ≈4× faster (≈7.6 s, ≈$0.005/round) because grading is deterministic

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i? Measured on the live backend, short-answer rounds cost ≈32 s and ≈$0.015 each, while multiple-choice rounds take ≈7.6 s and ≈$0.005 because only next-item generation calls the LLM. → Kailai He 2026

Evidence

Kailai He 2026

Kailai He, Zhihao Wu, Linhai Zhang, Runcong Zhao, Yulan He, Jiazheng Li. (2026). CoLearn: An Agentic Tutor that Learns its Learner in a Human–AI Co-Learning Loop. https://arxiv.org/abs/2609.21154 doi:10.48550/arxiv.2609.21154

q2 · i? · design · r2

Latency and cost measured on the live single-node deployment (AWS Bedrock, Claude Sonnet 4.5); the article reports "Short-answer ≈32 s/round (grade+feedback dominate); MCQ ≈7.6 s (determin- istic answer)" with cost estimated from token usage.

"Short-answer ≈32 s/round (grade+feedback dominate); MCQ ≈7.6 s (determin- istic answer). Cost is estimated from token usage."

Discussion

Page metadata
Field Value
type claim
id collearn-latency-cost-efficiency
title On the live single-node deployment, short-answer rounds take ≈32 s (≈$0.015/round) while multiple-choice rounds are ≈4× faster (≈7.6 s, ≈$0.005/round) because grading is deterministic
description On the live single-node deployment, short-answer rounds take ≈32 s (≈$0.015/round) while multiple-choice rounds are ≈4× faster (≈7.6 s, ≈$0.005/round) because grading is deterministic
status review
evidence_strength weak
newest_evidence 2026
generated by process:wiki-ingest on 2026-10-10
trust unverified — no one has confirmed this page's content
sources 1 — kailai-he-2026

Frontmatter is the page's machine-readable record — see the Schema & Guide.