Synchronised Log and Observation Data Collection

Description

Pair automated interaction logs with a time-aligned contextual channel such as video, observer notes or a survey, so each logged event can be explained.

Logs record what happened with precision but not why; video and observation capture goals, frustration and satisfaction but are hard to quantify. Synchronised collection keeps both, aligned on a common clock, so an analyst can jump from a log event to the matching video moment or observer note. Variants include an observer keeping a timestamped log aligned to the system log, video annotated after the session, a proxy plus instrumented browser for breadth and detail, and remote logged sessions ending with a short satisfaction survey. Clock synchronisation and tooling that displays events alongside annotations are what make it rigorous; without them, triangulation becomes anecdotal matching. It costs more than a single channel in set-up and analysis time.

Attributes

Loss type
Renamed
Data
Mixed
Effort
Weeks

Steps

  1. Choose the primary automated log and define the events it must capture.
  2. Add at least one contextual channel: video, live observer notes or an end-of-session survey.
  3. Synchronise clocks across streams before the session, for example with a shared start marker.
  4. Record sessions and keep raw streams together with session identifiers.
  5. Use software that shows log events alongside video and annotations.
  6. Interpret events in context, coding why behaviour occurred, and quantify patterns from the log.

Sources

  • Research Methods in HCI (Lazar et al., 2017)
  • Handbook of Usability Testing (Rubin & Chisnell, 2008)

Also known as

  • Hybrid log and observation data collection
  • Log-video synchronisation
  • Synchronised multi-stream data collection

Categories

  • User Research
  • Usability & Evaluation