Formal verification with human behaviour models

Description

Compose a formal model of user or team behaviour with a model of the device, then model-check safety properties under normal behaviour and generated errors or plausible slips.

Two families of approach include the human in formal verification. EOFM writes the operator's task analysis as a formal hierarchy of goal-directed activities with preconditions and completion conditions, decomposed into observable actions; EOFMC adds team communication. It is composed with device and environment models and checked, first with normative behaviour and then with a bounded number of generated phenotype errors, attentional slips or miscommunications, raising the bound until a property fails. Generic user models instead formalise cognitively plausible behaviour (responding to prompts, acting on visible task cues, habits, stopping when the goal seems done) and check that the goal is always achieved and the device left safe. Failing traces explain systematic errors such as post-completion errors. Applications include air traffic read-back protocols, checklists, infusion pumps and radiotherapy.

Attributes

Loss type
Siloed
Effort
Months

Steps

  1. Model the normative individual or team task from documents, observation and manuals, as an EOFM hierarchy or by instantiating a generic user model (prompts, cued actions, habits, goal and invariant).
  2. Build a formal model of the device, automation and environment without the human.
  3. Compose the human and device models so user actions are device inputs and device outputs are perceptions.
  4. Write safety and goal properties in temporal logic, with a check that they are not vacuously true.
  5. Model-check with zero generated errors, then raise the bound on slips, phenotype errors or miscommunications step by step.
  6. Inspect counterexample traces with a visualiser and explain them in cognitive terms.
  7. Change the procedure, protocol, manual or interface (for example return the card before the cash) and re-verify.

Sources

  • The Handbook of Formal Methods in HCI (Weyers et al., 2017)

Also known as

  • Enhanced Operator Function Model
  • EOFM
  • EOFMC
  • Formal task analytic verification
  • Human-automation interaction model checking
  • Generic user model verification
  • Cognitively plausible user model analysis
  • Formal user modelling for systematic human error

Categories

  • Accessibility
  • Human Factors & Error