Think-Aloud Protocol with Systematic Probe Schedules

Description

Think-aloud sessions in which moderator probes are pre-planned and triggered by defined behavioural events, keeping elicitation consistent across participants and limiting reactivity.

Think-aloud is the core usability method, but moderation is usually improvised: moderators interrupt at different moments with different questions, introducing reactivity and making sessions incomparable. A systematic probe schedule fixes this. Before sessions, the researcher defines trigger events (for example hesitation over 3 seconds, backtracking, silence over 15 seconds, an error, or reaching a key decision point) and writes a standard, neutral probe for each, such as 'keep talking' for silence, or 'what are you looking for?' after backtracking. Probes are delivered only when triggers occur, and retrospective probes are reserved for the end. This draws on Ericsson and Simon's distinction between concurrent verbalisation, which preserves cognitive processes, and explanation, which alters them, and Boren and Ramey's speech-communication guidance.

Attributes

Loss type
Vestigial
Stage
Evaluation
Effort
Days

Steps

  1. Before the session: for each critical task step, define:
  2. the behavioral trigger (e.g., 'user pauses > 3s'),
  3. the probe question ('I noticed you paused — what's going through your mind?'). During session: when trigger fires, deliver the probe. After session: code probes separately from spontaneous verbalizations. This separates researcher-elicited from user-generated cognition.

Sources

  • Handbook of Usability Testing
  • Ericsson & Simon, Protocol Analysis: Verbal Reports as Data (1993)
  • Boren & Ramey, Thinking aloud: Reconciling theory and practice (IEEE TPC, 2000)

Also known as

  • Structured probing in think-aloud
  • Event-triggered probes
  • Probe schedule think-aloud

Categories

  • User Research
  • Usability & Evaluation