Automatically coded dialogue acts correlate with manually coded collaborative activities as expected¶
Claim · All claims
Evidence · 1 study · designr3·q3
Currency · newest study 2008 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2011: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Correlating automatically coded dialogue acts (form) with manually coded collaborative activities (content) across four manual dimensions and 15 categories was used to establish convergent validity, with weak to moderate correlations expected. → Erkens 2008
Evidence¶
Erkens 2008¶
Erkens, G., & Janssen, J. (2008). Automatic coding of dialogue acts in collaboration protocols. Computer-Supported Collaborative Learning, 3, 447-470. https://doi.org/10.1007/s11412-008-9052-6
q3 · i? · design · r3
Validity analysis correlating automatic dialogue act coding with a manual coding scheme for collaborative activities (task-related activities, regulation of task-related activities, social activities, and regulation of social activities; 15 categories). The manual scheme's reliability was Cohen's kappa .86 in Study 1 (601 segments) and .94 in Study 2 (796 segments). Expected correlations included arguments with TaskExch and confirmations with SociUnd+; the article states "Weak to moderate correlations are thus to be expected."
"For the current analysis, the manually coded collaborative activities were correlated with the automatically coded dialogue acts."
Discussion¶
Related Claims¶
- DAC reliability varies by category: Informatives (especially negative evaluations and nonsense statements) code poorly
- Automatically coded dialogue acts distinguish male and female students' online communication
- Automatic DAC coding of dialogue acts agrees substantially with manual coding (79.0% agreement, kappa 0.75) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
dac-correlates-with-manual-collaborative-activities |
title |
Automatically coded dialogue acts correlate with manually coded collaborative activities as expected |
description |
Automatically coded dialogue acts correlate with manually coded collaborative activities as expected |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2008 |
recheck_by |
2011 |
generated |
by process:wiki-ingest on 2026-10-18 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — erkens-2008 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.