Cabuu vocabulary app log data and twice-daily diary protocol for measuring observable and subjective engagement¶
Design · All designs
Evidence · 5 claims (5 for) · 1 study (1 associational),q2· 1 of 1 report an effect size · 5 claims rest on one study
Description¶
The measurement setup combines commercial app log data with daily diaries: log timestamps of study and test activities are aggregated into a daily score of "how many vocabulary items were studied or tested by each participant per day," treating engagement as quantity rather than correctness. Children answered single-item diaries before learning (expectancy, value facets, cost facets) and after learning (satisfaction, effort, task delay) on 32 of 36 days, with timestamp checks enforcing temporal order.
Design Implications¶
Context¶
Requirements¶
- Timestamp validation that pre-learning diaries precede first app interaction and post-learning diaries follow app use
Constraints¶
- The score does not differentiate study from test activities and ignores correctness, given varied activity types and no uniform correctness metric
Target Learners¶
- fifth graders learning English vocabulary in an informal out-of-school setting
Learning Goals¶
- vocabulary learning; situational motivation and engagement measurement
Claims¶
- Vocabulary engagement measured by app logs varies mostly within students across days [+W]
- Subjective task value and cost emerge as two distinct factors in daily motivational appraisals of vocabulary learning [+W]
- Within-person correlations between log-based vocabulary engagement and appraisals and subjective engagement are positive but very small [+W]
- Between-person value is weakly linked to app engagement, with no significant between-person links to subjective engagement measures [+W]
- The three-phase model received partial support with weak self-report–behaviour correspondence in fifth graders' mobile vocabulary learning [+W]
Related Designs¶
Examples¶
-
Key Sources¶
- Breitwieser, J., Brod, G., & Malmberg, L.-E. (2026). Testing a three-phase model of the relationship between motivational appraisals, observable engagement, and subjective engagement: Insights from combining mobile learning data and daily diaries. Journal of Educational Psychology. Advance online publication. https://doi.org/10.1037/edu0001009
Page metadata
| Field | Value |
|---|---|
type |
design |
id |
cabuu-log-diary-engagement-measurement-protocol |
title |
Cabuu vocabulary app log data and twice-daily diary protocol for measuring observable and subjective engagement |
description |
The measurement setup combines commercial app log data with daily diaries: log timestamps of study and test activities are aggregated into a daily score of "how many vocabulary items were studied or tested by each par... |
status |
review |
generated |
by process:settle-candidates on 2026-10-25 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — breitwieser-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.