Sentence verification technique

Description

Participants verify statements such as 'A canary is a bird' as fast as possible; reaction times reveal typicality and the structure of category knowledge.

Participants see category or property statements ('An apple is a fruit', 'A canary can fly') and press true or false as quickly as possible. Collins and Quillian (1969) found statements crossing more links in a semantic hierarchy took longer. Smith et al. (1974) showed typical members (apple) are verified faster than atypical ones (pomegranate). The hierarchical model did not survive: it cannot explain typicality, and 'A pig is an animal' is verified faster (1,268 ms) than 'A pig is a mammal' (1,476 ms) (Rips et al. 1973), supporting feature-comparison and spreading-activation accounts. As a measurement tool, verification RT is a sensitive index of how central an item is to a category in users' minds, which bears directly on labels, navigation categories and taxonomy placement.

Attributes

Loss type
Unmigrated
Effort
Days

Steps

  1. Write statements pairing candidate items with categories or properties, plus an equal number of false statements.
  2. Balance statement length and word frequency across conditions.
  3. Present statements one at a time in random order and record true/false responses and reaction time.
  4. Include practice trials and exclude error trials and outliers (for example beyond 2.5 SD) from RT analysis.
  5. Compute mean RT per item-category pair and correlate with typicality ratings if collected.
  6. Use slow or error-prone pairs to identify items whose category membership is weak in users' minds.

Sources

  • Cognitive Psychology (Goldstein, 2019)
  • Cognitive Psychology (Sternberg & Sternberg, 2012)

Also known as

  • Sentence verification of hierarchical semantic networks
  • Collins and Quillian verification task
  • Category verification task
  • Typicality verification

Categories

  • User Research
  • Cognitive Psychology & Perception