Cultural Consensus Analysis

Description

Estimates whether a group shares a single body of knowledge, each person's competence in it, and the culturally correct answers, without knowing the answers in advance.

The cultural consensus model treats agreement among informants as evidence of shared knowledge. Factor analysis of the respondent-by-respondent agreement matrix tests whether a single dominant factor exists (first-to-second eigenvalue ratio above about 3), estimates each informant's cultural competence, and weights their answers to derive the 'culturally correct' answer key. Residual agreement analysis reveals subcultures. In UX, consensus analysis tells you whether a user group shares a mental model or vocabulary (e.g. what counts as 'urgent'), who the most knowledgeable informants are, and whether different groups hold different models, all with modest samples of 20-30.

Attributes

Loss type
Unmigrated
Stage
Discovery
Effort
Days

Steps

  1. Develop items about the domain (true/false, multiple choice, or rankings), often derived from free lists or interviews.
  2. Administer to informants from the target group(s).
  3. Compute the agreement matrix corrected for guessing and factor it (e.g. with UCINET or the CCTpack/AnthroTools packages).
  4. Check the eigenvalue ratio for a single culture and that competences are positive.
  5. Estimate the culturally correct answers and informant competences; examine residuals for subgroups.
  6. Use results to define shared models for design and to select expert informants for deeper interviews.

Sources

  • Romney, Weller & Batchelder, Culture as consensus: A theory of culture and informant accuracy (1986), American Anthropologist
  • Weller, Cultural consensus theory: Applications and frequently asked questions (2007), Field Methods

Also known as

  • Cultural consensus model
  • CCM
  • Consensus analysis

Categories

  • Analytics & Behaviour
  • Statistics & Modelling