Mystery Shopping

Description

A trained researcher uses a service incognito, as an ordinary customer would, and reports against a checklist of quality features.

Mystery shopping is a form of observational research in which the researcher plays the role of a user, visitor or customer to find out what the experience of using a facility, product or service is really like. The mystery shopper uses the facilities or services on an incognito basis, carrying a checklist of features to observe, such as cleanliness, the availability and clarity of information, and staff performance, and writes a report after the visit. Veal and Darcy point out that it draws on the observer's expertise to judge service quality and to notice details, for example safety problems, that routine users might miss. They also warn that ethical and industrial relations issues can arise because of the deception involved, since the researcher is typically acting for management and staff are being assessed without knowing it. In UX and service design the method is useful for evaluating end-to-end journeys that cross digital and human touchpoints, such as sign-up, delivery, returns or support, where lab testing cannot reproduce the real service and staff behaviour.

Attributes

Loss type
Siloed
Data
Mixed
Effort
Weeks

Steps

  1. Define the journey or service episodes to be evaluated and the standards they should meet.
  2. Build a checklist of observable features, with clear rating criteria, covering every touchpoint in the journey.
  3. Agree the ethical position with management and, where appropriate, staff representatives, including how findings about individuals will be used.
  4. Brief and train shoppers to behave like typical customers and to record observations soon after each episode.
  5. Carry out the visits or online journeys across a planned spread of locations, channels, days and times.
  6. Compile checklist scores and narrative reports, and look for patterns rather than blaming individual staff.
  7. Feed the findings into journey maps and service blueprints and recheck after changes.

Sources

  • Veal, A. J. & Darcy, S., Research Methods in Sport Studies and Sport Management (2014)

Also known as

  • Mystery customer research
  • Secret shopper evaluation
  • Incognito service audit

Categories

  • User Research
  • Usability & Evaluation