Two-dimensional rubric coding operational process category and depth of explicit metacognitive evidence¶
Research Method · All research methods
Evidence · 4 claims (4 for) · 1 study (1 qualitative),q2· 0 of 1 report an effect size · 4 claims rest on one study
Description¶
The article introduces a shared coding rubric applied identically to interaction logs and think-aloud speech. "Dimension 1, operational process category, answered what metacognitive function was observable and assigned planning, monitoring, or regulation. Dimension 2, depth of explicit metacognitive evidence, answered how explicitly and integratively the unit articulated a goal, criterion, procedure, evaluation, or transfer and assigned implicit, awareness, strategic, or reflective." Depth is an ordinal property of the evidence in a semantic unit, not a taxonomy of processes or a measure of learner proficiency, and boundary rules govern ambiguous cases such as criterion-free versus criterion-tied judgments.
Accounts¶
- Two-dimensional rubric coding operational process category and depth of explicit metacognitive evidence: The article introduces a shared coding rubric applied identically to interaction logs and think-aloud speech. "Dimension 1, operational process category, answered what metacognitive function was observable and assigned planning, monitoring, or regulation. Dimension 2, depth of explicit metacognitive evidence, answered how explicitly and integratively the unit articulated a goal, criterion, procedure, evaluation, or transfer and assigned implicit, awareness, strategic, or reflective." Depth is an ordinal property of the evidence in a semantic unit, not a taxonomy of processes or a measure of learner proficiency, and boundary rules govern ambiguous cases such as criterion-free versus criterion-tied judgments. (Li Shijin et al. (2026))
Claims¶
- Retained monitoring units showed a higher combined strategic-plus-reflective share in think-aloud speech than in interaction logs (66.7% vs 41.3%) [+W]
- Retained regulation units showed a higher combined strategic-plus-reflective share in interaction logs than in think-aloud speech (69.3% vs 55.3%) [+W]
- Retained planning units showed a higher combined strategic-plus-reflective share in think-aloud speech than in interaction logs (59.4% vs 49.5%) [+W]
- In both interaction-log and think-aloud records from a GenAI-assisted instructional-design task, regulation was the most frequent operational label and monitoring the least frequent [+W]
Related Research Methods¶
Key Sources¶
- Li Shijin & Liu Junjian. (2026). Mapping the Distribution and Depth of Metacognitive Processes in Generative AI-Assisted Learning: Evidence from Interaction Logs and Concurrent Think-Aloud Protocols. Behavioral Sciences. https://doi.org/10.3390/bs16081365
Page metadata
| Field | Value |
|---|---|
type |
research-method |
id |
two-dimensional-rubric-coding-operational-process-category-and-depth-of-explicit-metacogni |
title |
Two-dimensional rubric coding operational process category and depth of explicit metacognitive evidence |
description |
The article introduces a shared coding rubric applied identically to interaction logs and think-aloud speech. |
status |
review |
generated |
by process:settle-candidates on 2026-10-12 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.