SUMI (Software Usability Measurement Inventory)

Description

A 50-item questionnaire with a global usability score and five subscales (efficiency, affect, helpfulness, control, learnability), scored against a normative database.

The SUMI was built with unusually thorough psychometrics: 150 candidate items were cut to 75 by expert review, then to 50 by factor analysis of 139 users, and the five-factor structure was confirmed on an independent sample. Items use a three-point scale (agree, undecided, disagree) and mix positive and negative statements. A Global scale uses the 25 items that load most strongly on general usability. Its distinctive strength is standardisation: scores are converted against a reference database so 50 is average and the standard deviation is 10, making comparisons with other software meaningful. It was widely used in European ISO 9241 work and is available in 12 languages under licence (free for students).

Attributes

Loss type
Siloed
Effort
Hours

Steps

  1. License the SUMI from the Human Factors Research Group and choose the language version.
  2. Have at least 10 to 12 representative users complete it after real use of the software.
  3. Submit responses for scoring against the reference database.
  4. Read the Global score and the five subscale scores (mean 50, SD 10) with their confidence intervals.
  5. Use item consensual analysis to find specific items where your users differ most from the norm.

Sources

  • Quantifying the User Experience (Sauro & Lewis)
  • Measuring the User Experience (Tullis & Albert)

Also known as

  • SUMI
  • CUSI (Computer Usability Satisfaction Inventory)

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics