The understand-solve-check cognitive model accounted for 71% of protocol subjects' verbalizations¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 1993 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 1996: tool and model accuracy changes quickly

Subclaims¶

q2 i? The cognitive model's categories sufficed to encode 71% of the verbalizations of the three think-aloud subjects, supporting the validity of attributes derived from the model. → Katz 1993

Evidence¶

Katz 1993¶

Katz, I. R., Martinez, M. E., Sheehan, K. M., & Tatsuoka, K. K. (1993). Extending the Rule Space Model to a Semantically-Rich Domain: Diagnostic Assessment in Architecture. Educational Testing Service. https://eric.ed.gov/?id=ED366652 doi:10.21236/ada273789

q2 · i? · design · r2

Verbal protocol analysis of three think-aloud subjects, with categories defined from a pilot subject and inter-rater agreement of 82% on the doubly-scored portion. The authors report the model "accounted for 71% of the verbalizations"; no effect size is printed.

"The cognitive model accounted for 71% of the verbalizations made by subjects; the remaining verbalizations fell into the miscellaneous category."

Discussion¶

Related Claims¶

• Rule Space successfully classified most examinees in architecture, with solve attributes the most powerful and check attributes the least powerful — related
• Faded steps were hypothesized to trigger specific self-explanation activities, tested via think-aloud protocols in Experiment 2 — related
• The most prevalent verbalization type was labeling text parts as important without stating any reason for selection — related
• The think-aloud measure predicts word problem solving performance, explaining 33 percent of variance — related