Metaphor-based icon simulation test

Description

Tests whether users possess the source-domain experience a metaphorical icon depends on, by asking them to simulate and predict what tapping it will do.

Most interface icons are metaphors: a trash can for deletion, a floppy disk for saving, a wallet for stored value. Embodied cognition holds that understanding a metaphor involves mentally simulating the source experience. If a user has never handled the source object, or handles it differently, the simulation fails or produces the wrong prediction. This test separates two layers that ordinary icon tests conflate: recognising the depicted object, and simulating the right action from it. Participants first name the object, then describe what they would expect to happen if they used it, and finally predict the system consequence. Rigour comes from scoring each layer separately, sampling users with different source-domain experience, and using pre-set pass thresholds rather than impressionistic judgement.

Attributes

Loss type
Unmigrated
Data
Mixed
Effort
Days

Steps

  1. Select the metaphorical icons that carry critical or irreversible actions, and for each write down the intended source object, the intended simulated action and the intended system consequence.
  2. Recruit at least 15 to 20 participants per segment, deliberately including users whose material environment differs from the designers' (for example no desktop computers, no paper filing, cash-only economies).
  3. Present each icon in isolation, then in context, and ask in sequence: 'What object is this?', 'What would you do with this object in daily life?', 'If you tap it here, what will happen?'
  4. Score each response on three layers (object recognised, source action correct, system consequence correct) using a pre-agreed rubric, with a second scorer on at least 25% of responses.
  5. Apply a pass criterion per icon, for example at least 85% correct system-consequence predictions and no more than 5% critical confusions for destructive actions, following ANSI Z535.3 practice for safety symbols, or 66.7% under ISO 9186 for general symbols.
  6. Diagnose failures by layer: object not recognised means a depiction problem; object recognised but wrong action means a metaphor transfer failure requiring a different source domain or a text label.
  7. Redesign and retest failing icons with fresh participants until they meet the threshold.

Sources

  • Women Fire & Dangerous Things (Lakoff)
  • Metaphors We Live By (Lakoff)
  • Methods Atlas — frame audit (Gopinath)
  • The Inquiry Series, Ch 19 — Neural Framing & the Architecture of Meaning

Also known as

  • Metaphor icon test
  • Icon action-prediction test
  • Source-domain icon test

Categories

  • User Research
  • Cognitive Psychology & Perception