Moderated Usability Testing

Description

A usability test in which a facilitator guides each session live, probing behaviour and adapting follow-up questions to understand problems in depth.

In moderated usability testing a researcher conducts each session in real time, in person or remotely, introducing tasks, observing behaviour and asking follow-up questions. The facilitator can clarify task misunderstandings, probe unexpected behaviour and explore the reasoning behind actions, which makes it well suited to complex flows, early concepts and specialist users. The trade-off is that the facilitator can also bias participants. Rigour comes from a written discussion guide with consistent task wording, neutral probes, deliberate decisions about when to intervene, separating observation from interpretation through note-takers or observers, and debriefing with observers after each session. Small samples of five to eight participants per segment are typical for formative work.

Attributes

Loss type
Active
Effort
Days

Steps

  1. Write a discussion guide with introduction, warm-up questions, task scenarios and debrief questions.
  2. Recruit 5 to 8 participants per segment and schedule 45 to 60 minute sessions.
  3. Pilot the guide and adjust timing and wording.
  4. Facilitate sessions using neutral language, asking open follow-ups such as 'what did you expect to happen?' after tasks.
  5. Have a separate note-taker log observations and quotes with timestamps.
  6. Debrief with observers after each session and capture emerging issues.
  7. Analyse across sessions, rate severity and report recommendations.

Sources

  • Moderated Usability Tests
  • Handbook of Usability Testing (Rubin & Chisnell)
  • Benchmarking the User Experience (Sauro)
  • How to Conduct a Quantitative Usability Test (Sauro)
  • Garcia-Ruiz, M. (ed.), Games User Research: A Case Study Approach (2016)

Also known as

  • Facilitated usability testing
  • In-person usability testing

Categories

  • User Research
  • Usability & Evaluation