Participate, Compete, Win (PCW) Framework

Description

Label each product initiative Participate, Compete or Win, with matching usability targets and sample sizes, prioritise features by card sort scores, and test the top features against one competitor.

The framework ties product ambition to explicit usability goals. Participate (a minimum viable product) needs at least 80% task success and average ratings of at least 3 out of 5 for usability, trust and learnability, with 10 participants. Compete needs parity with a chosen competitor, with 15-20 participants within-subjects or about 25 between-subjects. Win needs a meaningful, statistically significant 30% difference, with about 30 participants within-subjects or 64 between-subjects. A feature audit collects competitors' features from their sites, reviews and marketing; participants sort features into Must have, Nice to have and Not important, giving a feature importance score of 3 x Must + 2 x Nice - 1 x Not important. Summing scores for the features each product offers gives an availability score. Top features become tasks in a summative head-to-head test.

Attributes

Loss type
Siloed
Effort
Weeks

Steps

  1. Assign the initiative a Participate, Compete or Win tier with its success, rating and sample-size criteria.
  2. Audit competitor features from products, reviews, comparison sites and marketing.
  3. Run a feature prioritisation card sort with target users (Must have, Nice to have, Not important).
  4. Compute feature importance scores (weights 3, 2, -1) and an availability score per product.
  5. Choose one main competitor and write tasks around the top features.
  6. Run the summative test, measuring task success and ease of use, and report average and end-to-end workflow success.
  7. Compare results against the tier's criteria, iterate, and later validate prototype results on the live product.

Sources

  • Measuring the User Experience (Albert & Tullis, 2022)

Also known as

  • PCW framework
  • Feature importance score
  • Feature availability score
  • Workflow success rate
  • Participate, Compete, Win (PCW) framework with feature importance scoring

Categories

  • Design
  • Design & Product Practice