Description
Benchmarks a product by surveying existing users about their past experience, without having them do tasks.
Sauro distinguishes two kinds of benchmark. Task-based benchmarks watch people attempt tasks. Retrospective benchmarks ask current users to recall and rate their experience with standard instruments such as SUPR-Q, SUS, UMUX-Lite and NPS, plus top-task ratings and open comments. Retrospective studies are cheap, fast, can reach hundreds of real customers and include competitors' customers, but they capture attitudes and memory rather than behaviour and cannot pinpoint task-level problems. Many programmes run a retrospective benchmark every quarter and a task-based one annually.
Attributes
- Discipline
- Survey & Psychometrics
- Loss type
- Active
- Stage
- Post-launch
- Data
- Quantitative
- Effort
- Weeks
Steps
- Define the population of current users (and competitor users if comparing).
- Select standardised measures and a short list of top tasks to rate.
- Screen respondents for recent, real use of the product.
- Field the survey and clean the data for speeders and straight-liners.
- Report scores with intervals against previous waves and competitors, plus themes from verbatims.
Sources
- Benchmarking the User Experience (Sauro)
Also known as
- Retrospective benchmark
- Attitudinal benchmark survey
Categories
- Analytics & Behaviour
- Survey & Psychometrics