Description
Users perform test tasks with a prototype or product in their own setting, trading lab control for validity and coverage of context-of-use problems.
In field tests users still solve tasks, but in their workplace, home or public setting among other people going about normal activities. This exposes far more aspects of mobile use and of cultural and organisational usability, improving coverage and validity, at the cost of control, robustness and logistics. In one study only 31% of 77 problems found concerned the product itself; the rest concerned context such as interfaced systems, environment, documentation and training. Preparation includes learning the site, planning observation and sometimes migrating the prototype to users' equipment. Think-aloud is often impossible in social settings, so evaluators interject occasional questions, rely on observation and post-task questions, or run retrospective think-aloud cued by screen recordings. Bystanders may make video consent impossible, and problem frequency is a weaker severity indicator than in the lab.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Active
- Stage
- Evaluation, Post-launch
- Data
- Qualitative
- Effort
- Weeks
Steps
- Visit and learn the site, and plan how observation and recording will work.
- Migrate the prototype to users' equipment if needed and check it works in place.
- Give tasks, often open-ended, in the live setting.
- Observe, interjecting occasional questions instead of continuous think-aloud.
- Record the screen and avoid video of bystanders who have not consented.
- Optionally hold a retrospective think-aloud cued by the screen recording.
- Analyse product and context problems separately, treating frequency-based severity with care.
Sources
- Usability Testing: A Practitioner's Guide (Hertzum, 2020)
- Handbook of Usability Testing (Rubin & Chisnell, 2008)
- Human-Computer Interaction (Dix et al., 2004)
- Customer Analytics for Dummies (Sauro, 2015)
Also known as
- In-situ usability test
- Field usability test
- In-context usability testing
Categories
- User Research
- Usability & Evaluation