Common Industry Format (CIF) Usability Report

Description

A standard format for summative usability test reports, covering product, participants, context, tasks and effectiveness, efficiency and satisfaction results, so purchasers can compare products.

In 1997 NIST convened software makers and large purchasers to agree how summative usability results should be reported so customers could compare products. The resulting Common Industry Format became ANSI/INCITS 354 and then ISO/IEC 25062. A CIF report describes the product, test objectives, participants (numbers and characteristics), context of use and environment, tasks and procedure in enough detail for replication, and reports effectiveness (completion rates, errors), efficiency (task time and its ratio to completion) and satisfaction (a standard questionnaire) with variability. The format turns usability from opinion into evidence that contracts and procurement can rely on. A separate effort produced guidance for formative reports. The authors stress the general principles behind it: know who will read the report and keep it concrete.

Attributes

Loss type
Siloed
Effort
Weeks

Steps

  1. Run a summative test with defined tasks and representative participants, typically at least 8 per user group.
  2. Describe the product, test objectives, participants, context of use and test environment.
  3. Describe tasks, procedure, instructions and measures in replicable detail.
  4. Report effectiveness (completion rate, errors), efficiency (time on task, completion per unit time) and satisfaction (standard questionnaire) per task, with variability.
  5. Add an executive summary written for purchasers and managers, keeping all statements concrete.
  6. Archive raw data so results can be audited or compared with later releases.

Sources

  • Designing the User Interface (Shneiderman et al., 2018)

Also known as

  • Common Industry Format Report
  • CIF
  • ANSI/INCITS 354
  • ISO/IEC 25062 usability test report
  • Standard summative usability report

Categories

  • User Research
  • Usability & Evaluation