Generic Error Modelling System (GEMS)

Description

Classifies errors by the cognitive level at which they occur, separating skill-based slips and lapses from rule-based and knowledge-based mistakes, each with distinct remedies.

GEMS integrates Rasmussen's skill-rule-knowledge framework with Reason's slips, lapses and mistakes. At the skill-based level, errors come from attentional failures (slips, such as capture errors) and memory failures (lapses). When a problem is detected, people move to the rule-based level, where they misapply good rules or apply bad ones. When no rule fits, they enter knowledge-based reasoning, prone to bounded rationality, confirmation bias and incomplete mental models. GEMS gives an explicit diagnostic flow: was the user monitoring, problem-solving or reasoning from first principles when the error occurred? The rigour comes from assigning each observed error to a mechanism, which then dictates the fix: forcing functions for slips, better feedback for lapses, clearer rules and signs for rule-based mistakes, and better representations for knowledge-based ones.

Attributes

Loss type
Latent
Effort
Days

Steps

  1. Collect error incidents from usability sessions, support tickets, logs or critical incident interviews, with enough context to reconstruct intention.
  2. For each incident, establish whether the intention was correct (execution failure) or incorrect (planning failure).
  3. Classify execution failures as slips (attention: capture, description, mode errors) or lapses (memory: omissions, place-losing).
  4. Classify planning failures as rule-based (misapplied good rule, applied bad rule, strong-but-wrong rule) or knowledge-based (incomplete model, confirmation bias, overconfidence).
  5. Check classification reliability with a second coder and compute Cohen's kappa, targeting at least 0.6.
  6. Map each error class to its remedy family and prioritise redesigns by frequency times severity.

Sources

  • Reason, Human Error (1990)
  • Rasmussen, Information Processing and Human-Machine Interaction (1986)

Also known as

  • GEMS
  • Reason's GEMS

Categories

  • Accessibility
  • Human Factors & Error