Description
Challenge skilled, motivated users to make the product fail, lose data or hit dead ends, rather than complete set tasks.
Standard usability tests emphasise first-time use and touch a small fraction of features within one to three hours. In a can-you-break-this test, capable and energetic users are instead challenged to find fatal flaws: crashes, data loss, dead ends and unrecoverable states. The approach comes from game studios that invited teenagers to beat new games before release, and Shneiderman and colleagues argue it deserves wider use because users quickly abandon flawed products. It pushes towards edge cases, unusual sequences and error states scripted tasks rarely reach. Rigour comes from recording every action so failures can be reproduced, and from triaging failures by severity, reproducibility and how likely ordinary users are to meet them.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Siloed
- Stage
- Evaluation
- Data
- Qualitative
- Effort
- Days
Steps
- Recruit skilled, motivated testers such as power users, gamers or domain experts.
- Frame the session as a challenge: find any way to make the product fail, lose data or reach a dead end.
- Log all actions and record the screen so each failure can be reproduced.
- Optionally reward each distinct, reproducible failure to sustain motivation.
- Triage failures by severity, reproducibility and likelihood for ordinary users.
- Fix and retest the highest-priority failures.
Sources
- Designing the User Interface (Shneiderman et al., 2018)
Also known as
- Destructive testing
- Break-it test
- Adversarial user testing
Categories
- User Research
- Usability & Evaluation