Discount Usability Engineering (Nielsen's Original)

Description

An economic framework combining simplified think-aloud tests, scenarios and heuristic evaluation, with attention to detection rates, evaluator reliability and severity.

Nielsen's discount usability argument was that simple, cheap methods capture most major usability problems, so practitioners should not wait for resources to run perfect studies. It combined scenarios, simplified thinking aloud and heuristic evaluation. The treatise argues the economic argument survived but the rest of the framework was lost: Nielsen's careful analysis of what each method can and cannot detect (problem discovery curves, the 1-(1-p)^n model), attention to evaluator reliability (aggregating 3-5 evaluators), the severity rating scale and the insistence that even discount methods apply theory-based heuristics systematically. Contemporary quick tests often lack all of these, producing unprioritised and unsystematic findings.

Attributes

Loss type
Vestigial
Effort
Days

Steps

  1. Write task scenarios representing core user goals.
  2. Run simplified think-aloud tests with about 5 users per user group, iterating designs between rounds.
  3. Conduct heuristic evaluation with 3-5 independent evaluators and aggregate findings.
  4. Estimate problem discovery coverage given observed problem frequencies.
  5. Rate every problem with the severity scale (0-4) using independent raters.
  6. Fix the highest-severity problems and iterate.

Sources

  • Lost Methods in UX — A Complete Treatise (Gopinath)
  • Nielsen J (1993) Usability Engineering. Academic Press
  • Nielsen J (1989) Usability engineering at a discount
  • Nielsen J & Landauer TK (1993) A mathematical model of the finding of usability problems. INTERCHI

Also known as

  • Discount usability
  • Discount usability testing

Categories

  • User Research
  • Usability & Evaluation