Least Competent User Recruitment and Best-Case Ringer Check

Description

Bracket a small usability-test sample by competence: always include the least skilled plausible users, use an expert insider only as an early go/no-go check.

A sampling discipline for small qualitative usability tests. The least competent user (LCU) is the least skilled person who could plausibly use the product, defined on the profile's own scales. Including one or more LCUs in every round, even for expert markets, gives a reading of ease of learning: if they muddle through, most others will; if they fail, the failure points to fundamental problems of intuitiveness, orientation or organisation rather than automatically demanding redesign. Early on, LCUs show mental models not yet shaped by competing products. At the other bracket, a best-case test with an experienced insider (a ringer) acts as a go/no-go gate: if even they struggle, testing stops and design resumes. The rigour lies in controlling who arrives, because recruiters, account managers and sales staff tend to send top performers who work around flaws and make the product test out better than it is.

Attributes

Loss type
Latent
Effort
Days

Steps

  1. When writing the user profile and screener, define the least competent user on the profile's own scales (domain, computer and product experience, education).
  2. Recruit at least one LCU into every test round, even when most target users are expert.
  3. Optionally run an early best-case session with an experienced internal ringer; if they fail core tasks, return to design before testing further, and if they pass, follow quickly with less experienced users.
  4. In early exploratory rounds, use LCUs to observe mental models before prior products have shaped them.
  5. Control the recruiting channel so customers, recruiters or sales staff cannot fill the sample with high achievers; cap such 'best' participants at one or two per round and document the trade-off.
  6. Interpret asymmetrically: LCU success suggests most groups will cope, while LCU failure flags fundamental intuitiveness, orientation or instruction problems to investigate rather than an automatic redesign.

Sources

  • Handbook of Usability Testing (Rubin & Chisnell, 2008)

Also known as

  • Least competent user (LCU)
  • Least competent users and competence bracketing
  • Best-case testing
  • Ringer check
  • 'Best people' trap

Categories

  • User Research
  • Usability & Evaluation