Retrospective (Survey-Based) UX Benchmark

Description

Benchmarks a product by surveying existing users about their past experience, without having them do tasks.

Sauro distinguishes two kinds of benchmark. Task-based benchmarks watch people attempt tasks. Retrospective benchmarks ask current users to recall and rate their experience with standard instruments such as SUPR-Q, SUS, UMUX-Lite and NPS, plus top-task ratings and open comments. Retrospective studies are cheap, fast, can reach hundreds of real customers and include competitors' customers, but they capture attitudes and memory rather than behaviour and cannot pinpoint task-level problems. Many programmes run a retrospective benchmark every quarter and a task-based one annually.

Attributes

Loss type
Active
Stage
Post-launch
Effort
Weeks

Steps

  1. Define the population of current users (and competitor users if comparing).
  2. Select standardised measures and a short list of top tasks to rate.
  3. Screen respondents for recent, real use of the product.
  4. Field the survey and clean the data for speeders and straight-liners.
  5. Report scores with intervals against previous waves and competitors, plus themes from verbatims.

Sources

  • Benchmarking the User Experience (Sauro)

Also known as

  • Retrospective benchmark
  • Attitudinal benchmark survey

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics