Vocabulary Breadth-and-Depth Probe

Description

For each target word, combine a self-rating of knowledge with sentence use, associations and a definition, revealing whether people truly know terms or only recognise them.

Vocabulary breadth is how many words someone knows; depth covers pronunciation and spelling, word parts, sentence frames, multiple meanings, associations and appropriate contexts. Recognition alone overstates knowledge. This probe asks, for each target word, a three-level self-rating of how well it is known, a sentence using it, as many connected words as possible in three minutes, and a definition. Definitions are judged against the formal 'An X is a Y that Z' form; they develop from personal and functional descriptions towards synonyms and category relations, and depend on schooling and reading. Comparing self-ratings with demonstrated knowledge shows where people believe they understand a term but cannot use or define it. In UX this turns terminology decisions (labels, jargon, financial and medical terms) from guesswork into measured knowledge profiles across audiences.

Attributes

Loss type
Unmigrated
Stage
Discovery, Design
Data
Mixed
Effort
Days

Steps

  1. Select the target words or terms, for example candidate interface labels or domain jargon.
  2. Ask for a three-level self-rating of knowledge for each word (do not know, have seen it, know it well).
  3. Ask the participant to write a sentence using the word.
  4. Give three minutes to list associated words.
  5. Ask for a definition of its meaning or meanings, and score it against the 'An X is a Y that Z' form.
  6. Compare self-ratings with demonstrated knowledge across words and participant groups.

Sources

  • The Development of Language (Gleason & Ratner, 2024)

Also known as

  • Word knowledge self-rating
  • Definition task
  • Vocabulary depth assessment
  • Word definitions

Categories

  • Content
  • Linguistics, Semiotics & Discourse