Comparative Segmentation Study

Description

Give matched designer pairs different user segmentations for the same design task and compare how each segmentation shapes their reasoning and ideas.

Segmentations and persona sets are usually judged by statistical fit, not by whether they help design. This study design tests their utility directly. Practitioners work in pairs on a realistic, time-boxed design task; each pair receives one of the competing segmentations, presented as the team's own research. Sessions are audio-recorded and observed, and the analysis focuses on discourse rather than design quality: whether designers identify with segments, which segments they keep or drop, and whether they propose segment-specific features. A post-task questionnaire asks pairs to assess their segmentation, then shows the alternative and asks them to compare. In the original study, pairs given Westin's privacy categories designed for one undifferentiated majority, while pairs given five behavioural clusters proposed features for specific segments.

Attributes

Loss type
Latent
Effort
Weeks

Steps

  1. Define the competing segmentations or persona sets and prepare equivalent presentation materials for each.
  2. Recruit practitioners with design-discussion experience and form pairs, assigning pairs to segmentations.
  3. Set a realistic redesign task with a fixed time limit, such as 30 minutes.
  4. Audio-record sessions and take field notes on design attributes and references to segments.
  5. Give a post-task questionnaire on the segmentation used, then show the alternative and ask for a comparison.
  6. Transcribe and code discourse: self-identification, segments kept or dropped, and segment-specific design ideas.
  7. Compare conditions and report which segmentation better supports differentiated design reasoning.

Sources

  • Privacy Personas (Dupree et al., 2016)

Also known as

  • Comparative design study of alternative user segmentations
  • Segmentation utility test with designer pairs
  • Persona-set comparison study

Categories

  • User Research
  • Usability & Evaluation