Customer Problem Stack Ranking (CPSR)

Description

Mines low-rated app reviews for pain points, rewrites them as first-person problem statements, and has users select and rank those affecting them over repeated small rounds.

Customer problem stack ranking asks users to rank problems, not features. White's adaptation seeds the problem list from online reviews: reviews rated 3 or below in a recent window, with sentiment below the median, are split into sentences, pricing and bug sentences are dropped, and pain-point sentences are clustered and rewritten as first-person statements ('I cannot...'). A short survey (3-6 minutes) asks users to select the problems that affected them, add missing ones, sort them by importance and explain. Rounds of about 20 users are repeated, keeping the top five and adding new statements from write-ins, so the list converges on the problems that matter most. Results feed problem or system mapping and follow-up interviews.

Attributes

Loss type
Latent
Data
Mixed
Effort
Days

Steps

  1. Pull app or product reviews and filter to ratings of 3 or below in a recent window, with sentiment below the median, dropping pricing and bug sentences.
  2. Cluster pain-point sentences and rewrite each cluster as a first-person problem statement.
  3. Survey about 20 users: select the problems that affected them, add missing ones, sort by importance and explain why.
  4. Keep the top five problems, add new candidates from write-ins, and run further rounds until the ranking stabilises.
  5. Follow up with problem or system mapping and interviews on the top-ranked problems.

Sources

  • Quant UX Con 2022 Proceedings (Chapman et al., 2022)

Also known as

  • CPSR
  • Problem stack ranking
  • Customer Problem Stack Ranking from app reviews

Categories

  • Analytics & Behaviour
  • Product Analytics & Strategy