Unmoderated Remote Testing

Description

Participants complete tasks on their own devices without a facilitator, recording screens and think-aloud, allowing fast, larger and geographically diverse samples.

Unmoderated remote testing uses an online platform to deliver tasks and questions to participants who complete them on their own, in their own environment and time. Sessions may record screen, audio and face, along with task success, time and post-task ratings. Because no facilitator is needed, tests can run in hours with dozens of participants across regions. The trade-off is the loss of real-time probing and clarification, so study design must anticipate misunderstandings. Rigour comes from unambiguous task wording, clear success criteria and validation questions, screening for attentive and representative participants, piloting, and combining behavioural metrics with recordings rather than relying on self-reported success.

Attributes

Loss type
Active
Stage
Evaluation
Data
Mixed
Effort
Days

Steps

  1. Define tasks, success criteria and post-task questions such as the Single Ease Question.
  2. Write self-explanatory task instructions and include validation questions to confirm success.
  3. Set screening criteria and recruit from a panel or your own users.
  4. Pilot with 2 to 3 participants and fix confusing instructions.
  5. Launch with 10 to 20 participants for qualitative insight, or 30 or more for metrics.
  6. Review recordings and exclude low-quality sessions with documented criteria.
  7. Analyse success, time, ratings and clips, and report findings.

Sources

  • UX Research
  • Rocket Surgery Made Easy
  • Beyond the Usability Lab (Albert, Tullis & Tedesco)
  • Benchmarking the User Experience (Sauro)
  • How to Conduct a Quantitative Usability Test (Sauro)

Also known as

  • Unmoderated usability testing
  • Asynchronous remote testing

Categories

  • User Research
  • Usability & Evaluation