Usability-Based Accessibility Measurement

Description

Measure accessibility as the effectiveness, efficiency and satisfaction of specified users with diverse capabilities on specified tasks and contexts, comparing by varying one factor at a time.

ISO 9241-11 defines usability as the extent to which specified users achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use. ISO TS 16071 defines accessibility as usability for people with the widest range of capabilities, so accessibility becomes measurable in the same way, rather than a binary pass or fail against guidelines. Accessibility is a function of user, task, context and product; valid comparison varies only one term at a time, such as the same user group, task and context on two products. Planning identifies accessibility requirements, measures and verification criteria within the context of use, which then act as design targets. The approach shows that a product can be accessible in one context and much less so in another, something conformance audits cannot reveal.

Attributes

Loss type
Latent
Effort
Weeks

Steps

  1. Specify the user categories with the capabilities of interest, their goals, tasks and context of use, including assistive technologies.
  2. Set quantitative accessibility goals per user category and context, such as completion rate, time and satisfaction targets.
  3. Recruit participants from each user category and have them perform the specified tasks in the specified context.
  4. Measure effectiveness (completion, errors), efficiency (time, effort) and satisfaction.
  5. For comparisons, vary only one of user, task, context or product at a time.
  6. Verify results against targets and document them, for example in a quality plan, alongside conformance audit findings.

Sources

  • ISO Standard on Ergonomics (Gulliksen et al., 2001)

Also known as

  • Usability-based accessibility measurement (ISO 9241-11 / ISO TS 16071)
  • Measurable accessibility
  • Accessibility as usability measurement

Categories

  • User Research
  • Usability & Evaluation