Systematic Probe Schedule

Description

Pre-defining behavioural triggers and matching probe questions for usability sessions, and coding probed responses separately from spontaneous think-aloud.

Think-aloud sessions often drift between unstructured observation and ad hoc questioning that varies across moderators and participants. A systematic probe schedule pre-defines, for each critical task step, a behavioural trigger (a pause over three seconds, backtracking, a verbal sign of confusion) and a standard probe question. When a trigger fires, the moderator delivers the probe, and analysis keeps probed responses separate from spontaneous verbalisation. This makes moderation consistent across sessions and moderators, reduces leading, and lets the analyst compare what participants think unprompted with what they say when asked. The discipline also exposes moderator effects that otherwise contaminate usability findings.

Attributes

Loss type
Latent
Stage
Evaluation
Effort
Days

Steps

  1. Pre-session preparation: For each critical task step in the usability test, define a behavioral trigger (e.g., "participant pauses > 3 seconds," "participant backtracks," "participant expresses confusion verbally") and a probe question ("I noticed you paused — what's going through your mind?").
  2. During the session: When a trigger fires, deliver the associated probe. Code probes separately from spontaneous verbalizations — this separates researcher-elicited from user-generated cognition in your analysis.
  3. Post-session analysis: Analyse spontaneous verbalizations and probe responses separately. Probe responses reveal what participants thought when asked; spontaneous verbalizations reveal what participants thought without prompting. The gap between them is informative.

Sources

  • Handbook of Usability Testing (Dumas & Redish)
  • Research Methods in HCI (Lazar)
  • A Practical Guide to Usability Testing (Dumas & Redish)

Also known as

  • Triggered probes
  • Event-based probing
  • Dumas and Redish probing protocol

Categories

  • User Research
  • Usability & Evaluation