Cognitive Task Analysis

Description

Elicits the knowledge, cues, judgements and decision strategies behind expert performance, capturing the cognitive demands that behavioural task analysis misses.

Cognitive task analysis extends traditional task analysis to the mental side of work: the knowledge, cues, judgements, decisions and strategies experts use, particularly under uncertainty and time pressure. Methods include the Critical Decision Method, which probes a specific challenging incident through repeated sweeps, knowledge audits, simulation interviews and think-aloud with protocol analysis. Outputs capture what experts notice that novices miss, how they assess situations and what makes decisions difficult. Rigour comes from anchoring elicitation in real incidents, structured probes for cues, goals, options and expectancies, multiple experts to separate idiosyncratic from shared knowledge, and representing findings in decision requirements tables that link to design and training implications.

Attributes

Loss type
Siloed
Effort
Weeks

Steps

  1. Identify the critical decisions and expert population, and recruit 6 to 10 experts of varied experience.
  2. Run Critical Decision Method interviews: elicit a challenging incident, build a timeline, then probe decision points for cues, goals, options and expectations.
  3. Supplement with knowledge audits or simulation interviews using realistic scenarios.
  4. Transcribe and code the data for cues, strategies, difficulties and errors.
  5. Build decision requirements tables describing each critical decision, why it is difficult, cues used and common errors.
  6. Validate with additional experts and translate findings into design and training requirements.

Sources

  • Handbook of Cognitive Task Design
  • Lost Methods in UX
  • Working Minds (Crandall, Klein & Hoffman)
  • Klein, Calderwood & MacGregor, Critical decision method for eliciting knowledge (1989), IEEE Transactions on SMC
  • Crandall, Klein & Hoffman, Working Minds: A Practitioner's Guide to Cognitive Task Analysis (2006)
  • Hoffman, Crandall & Shadbolt, Use of the critical decision method to elicit expert knowledge (1998), Human Factors

Also known as

  • CTA
  • Applied cognitive task analysis
  • Critical Decision Method
  • CDM
  • Critical decision method interview

Categories

  • User Research
  • Task Analysis & Cognitive Modelling