Mentalese consistency check

Description

Tests whether users across roles hold the same underlying concepts for interface terms, by eliciting their conceptual representations rather than their vocabulary.

Fodor's language of thought hypothesis proposes that thinking occurs in an internal representational system, 'Mentalese', distinct from natural language. Whatever its status as a theory, it suggests a useful distinction for UX: users can share a word but not a concept, or share a concept expressed with different words. A Mentalese consistency check elicits the concepts users attach to key terms using non-verbal or structured methods, such as sorting scenarios, predicting outcomes, or drawing what the term refers to, and compares these across roles and with the system's model. Where concepts diverge under the same word, the interface is ambiguous even if every label passes a copy review. Rigour comes from scenario-based elicitation and systematic comparison across groups.

Attributes

Loss type
Unmigrated
Data
Mixed
Effort
Days

Steps

  1. Select critical terms used across roles (for example 'case', 'save', 'complete', 'session').
  2. Write 8-12 scenarios illustrating different possible referents or effects of each term.
  3. Ask participants from each role (5-8 per role) to judge which scenarios the term applies to and predict system effects.
  4. Compare judgement patterns across roles and with the system's actual model; compute agreement (for example Fleiss' kappa within and between roles).
  5. Flag terms with between-role agreement below about 0.6 or mismatches with system behaviour.
  6. Resolve by splitting terms, adding qualifiers, or adjusting system behaviour, then re-check.

Sources

  • Fodor, J., The Language of Thought (1975)
  • Coulson, S., Semantic Leaps (2001)
  • Bergen, B., Louder Than Words (2012)
  • Lakoff, G., Women, Fire, and Dangerous Things (1987)
  • Language of Thought (Fodor)
  • Semantic Leaps (Coulson)
  • Louder Than Words (Bergen)
  • Women Fire & Dangerous Things (Lakoff)
  • The Inquiry Series, Ch 17 — Mentalese, Compositionality & the Language of Thought

Also known as

  • Conceptual consistency check
  • Language-of-thought alignment check

Categories

  • Content
  • Linguistics, Semiotics & Discourse