Model checking usability properties

Description

Model the interface formally, state generic usability properties such as reversibility, feedback and consistency as logical formulae, and let a model checker or prover test every reachable state.

A formal model of an interface can be analysed exhaustively. Model checking represents it as a finite-state machine and examines every reachable state, returning a counterexample when a property fails; theorem proving handles infinite states with analyst guidance. Generic usability properties have been catalogued: reversibility, undo within N steps, deadlock freedom, task completeness, predictability, reachability, honesty, feedback, behavioural consistency, visibility and more. Campos and Harrison's templates turn these into parameterised formulae over actions, states and modes, instantiated by choosing a guard, filters linking hidden state to its perceivable counterpart, and modes. Industrial results include 98 design errors found in a cockpit window manager from 563 properties. Adding assumptions about what information prompts each user step restricts checks to plausible behaviour.

Attributes

Loss type
Siloed
Effort
Weeks

Steps

  1. Choose the scope: interface only, functional core, and possibly user tasks.
  2. Model the system in a tool-supported notation such as statecharts, interactors or Petri nets, separating perceivable attributes, actions and modes.
  3. Select usability properties from the catalogue and instantiate templates with concrete guards, filters and modes (for example that a pump status colour always matches pump flow).
  4. Run the model checker over the full state space, or prove the theorem by induction over reachable states.
  5. Interpret counterexamples or failed proofs as candidate design problems, using a trace visualiser.
  6. Optionally add assumptions about the information that prompts each user step and re-check under them.
  7. Amend the model or design and re-check until results match expectations.

Sources

  • The Handbook of Formal Methods in HCI (Weyers et al., 2017)

Also known as

  • Formal verification of usability properties
  • Usability property model checking
  • Temporal-logic usability verification
  • Use-property template analysis
  • Property templates (Campos and Harrison)

Categories

  • Accessibility
  • Human Factors & Error