Guidelines Review and Consistency Inspection

Description

Experts check an interface against a written guideline set or style guide and across a product family for consistent terms, fonts, colours, layout and formats.

Two expert reviews work from documents rather than short heuristic lists. In a guidelines review, experts check every screen for conformance with a published set: WCAG and other W3C accessibility guidelines, platform guidelines from Apple, Google or Microsoft, government research-based guidelines, or an organisation's own style guide. Sets range from about 10 to over 1,000 items, so reviewers need time to absorb them and large interfaces can take days or weeks; shorter checkpoints can serve as heuristics. In a consistency inspection, experts check terminology, fonts, colour, layout and input and output formats within one interface and across a family of products and their help material, which matters most when several teams build parts of one system. Software aids include term concordances and string searches. A bird's-eye pass, printing or tiling every screen together, reveals inconsistencies at once. Reviewers should not have built the interface, and reviews should precede user testing.

Attributes

Loss type
Active
Effort
Weeks

Steps

  1. Choose the guideline set or style guide suited to platform, domain or legal requirement and decide which sections apply.
  2. Give reviewers who did not build the interface time to learn the guidelines and task domain.
  3. Inventory all screens, pages and supporting materials across the product family.
  4. Check each item for conformance, recording violations with location and guideline reference.
  5. Run automated aids: term concordances, string searches and accessibility validators.
  6. Do a bird's-eye pass by printing or tiling all screens and scanning for inconsistent fonts, colours, terms and layout.
  7. Report violations organised by guideline, ranked by importance and effort, and fix before user testing.

Sources

  • Research Methods in HCI (Lazar et al., 2017)
  • Designing the User Interface (Shneiderman et al., 2018)
  • Conceptual Foundations of Human Factors Measurement (Meister, 2004)
  • Human-Computer Interaction (Dix et al., 2004)
  • Usability Engineering (Nielsen, 1993)

Also known as

  • Guidelines review
  • Consistency inspection
  • Consistency review
  • Guideline inspection
  • Standards review
  • Guidelines conformance review
  • Bird's-eye view review

Categories

  • User Research
  • Usability & Evaluation