Three behavioral process indicators for operationalizing planning in complex problem solving from log data

Research Method · All research methods
Evidence · 5 claims (4 for, 1 mixed) · 1 study (1 associational), q3 · 1 of 1 report an effect size · 5 claims rest on one study

Description

The article introduces three behavioral indicators extracted from computer-generated log data to operationalize planning in complex problem solving: "the duration of the longest interval between two successive interactions (duration indicator)", "the delay of the longest interval between two successive interactions from the beginning of the process (delay indicator)", and "the variance of times between each two successive interactions (variance indicator)". These indicators capture planning behavior occurring in the time between interactions, which the authors take to include understanding, representing, formulating, monitoring, and reflecting processes from the PISA framework.

Accounts

• Three behavioral process indicators for operationalizing planning in complex problem solving from log data: The article introduces three behavioral indicators extracted from computer-generated log data to operationalize planning in complex problem solving: "the duration of the longest interval between two successive interactions (duration indicator)", "the delay of the longest interval between two successive interactions from the beginning of the process (delay indicator)", and "the variance of times between each two successive interactions (variance indicator)". These indicators capture planning behavior occurring in the time between interactions, which the authors take to include understanding, representing, formulating, monitoring, and reflecting processes from the PISA framework. (Eichmann et al. (2019))

Claims

• Models including task-dependent random effects fit CPS log data better than models with only fixed effects for all three planning indicators [+W]
• Significant interaction effects among duration, delay, and variance indicators show that the effects of planning behaviors on CPS performance are highly intertwined [+W]
• The duration of the longest planning interval shows no significant fixed effect on CPS performance but a significant task-dependent random effect [~W]
• The variance of planning time shows no significant fixed effect on CPS performance but a significant task-dependent random effect correlated with task difficulty [+W]
• Early planning in complex problem solving is generally beneficial, with a significant negative fixed effect of the delay indicator [+W]

Related Research Methods

-

Key Sources

• Eichmann, B., Goldhammer, F., Greiff, S., Pucite, L., & Naumann, J. (2019). The role of planning in complex problem solving. Computers & Education, 128, 1-12. https://doi.org/10.1016/j.compedu.2018.08.004

Page metadata

Field	Value
type	research-method
id	three-behavioral-process-indicators-for-operationalizing-planning-in-complex-problem-solvi
title	Three behavioral process indicators for operationalizing planning in complex problem solving from log data
description	The article introduces three behavioral indicators extracted from computer-generated log data to operationalize planning in complex problem solving: "the duration of the longest interval between two successive interactions (duration indicator)", "the delay of the longest interval between two success
status	review
generated	by process:settle-candidates on 2026-10-29
trust	unverified — no one has confirmed this page's content

Frontmatter is the page's machine-readable record — see the Schema & Guide.