Compositionality audit for UI copy

Description

Checks whether UI labels and messages combine predictably, so that the meaning of a compound phrase follows from its parts and users can generalise across the interface.

Compositionality holds that the meaning of a complex expression is determined by its parts and how they are combined. Fodor argued thought itself is compositional, and systematic: anyone who understands 'save draft' and 'delete file' should understand 'delete draft'. Interface language can violate this when the same verb means different things in different contexts ('Save' commits to a record for one role but stores locally for another), when compound labels have idiosyncratic meanings, or when combinations are missing. A compositionality audit inventories verbs, objects and modifiers, builds a grid of their combinations, and checks each for consistent meaning and behaviour. Rigour comes from mapping each label to its actual system effect, not its dictionary meaning.

Attributes

Loss type
Unmigrated
Stage
Design
Data
Mixed
Effort
Days

Steps

  1. Extract all action labels, menu items and messages and decompose them into verbs, objects and modifiers.
  2. For each verb, list every system effect it triggers across contexts and roles.
  3. Build a verb-by-object grid and mark combinations as consistent, inconsistent or missing.
  4. Flag verbs with more than one distinct effect and compounds whose meaning does not follow from parts.
  5. Test predictions with 6-10 users: show novel combinations and ask what will happen; target at least 80% correct predictions.
  6. Define a compositional vocabulary with one effect per verb and apply it across the product.

Sources

  • Fodor, J., The Language of Thought (1975)
  • Coulson, S., Semantic Leaps (2001)
  • Bergen, B., Louder Than Words (2012)
  • Lakoff, G., Women, Fire, and Dangerous Things (1987)
  • Language of Thought (Fodor)
  • Semantic Leaps (Coulson)
  • Louder Than Words (Bergen)
  • Women Fire & Dangerous Things (Lakoff)
  • The Inquiry Series, Ch 17 — Mentalese, Compositionality & the Language of Thought

Also known as

  • Compositional semantics audit
  • UI language compositionality review

Categories

  • Content
  • Linguistics, Semiotics & Discourse