Description
Straight after testing, observers pool their top problems, agree a ranked list of the most serious and commit to the simplest fixes achievable before the next round.
The debrief turns observation into commitment. Krug runs it over about an hour at lunch, open only to people who watched sessions. Everyone reads out their three most serious problems, repeats are marked, all items go on the wall, and the group or facilitator selects and ranks the ten most serious, judged by how many users will hit each and how badly. Working down the list without skipping, the team agrees the simplest fix for each until the month's fixing resources are committed, then a short email records what was tested, what will be fixed and when the next round is. Travis and Hodgson add that the meeting should be co-chaired with the product owner, attended by decision makers, kept to about 15 minutes of talk and 45 of discussion, start with the team's own reactions, and seek consensus on problems before solutions.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Active
- Stage
- Evaluation
- Data
- Qualitative
- Effort
- Hours
Steps
- Circulate a short summary in advance and ensure decision makers and observers attend; co-chair with the product owner.
- Explain the aim: agree the most serious problems and what will be fixed before the next round.
- Start with team reactions and surprises, then have each observer read their three most serious problems, noting repeats.
- Write all problems on the wall and choose the top five to ten by severity (how many users affected, how badly).
- Agree consensus on problems before discussing solutions, steering opinions back to observed evidence.
- Working down the ranked list without skipping, agree the simplest feasible fix for each until available resources are committed.
- Send a brief email listing tasks tested, problems to fix, owners, where recordings are and the next test date.
Sources
- Rocket Surgery Made Easy (Krug, 2010)
- Think Like a UX Researcher (Travis & Hodgson, 2019)
- Handbook of Usability Testing (Rubin & Chisnell, 2008)
Also known as
- Usability test debriefing meeting
- Top-ten fix list
- Lunchtime debrief
- UX debrief meeting
- Debriefing 101
Categories
- User Research
- Usability & Evaluation