Description
Train participants to a predefined, tested proficiency before a usability test so the test can examine ease of use for experienced users or advanced features.
Most usability tests observe novices and so measure ease of learning. Prerequisite training deliberately moves participants along the learning curve to a pre-established criterion first. Rubin and Chisnell give three uses: guaranteeing domain skills the product assumes (photography skill for a retouching tool), simulating users with a week or a month of use when no such users exist yet, and reaching advanced features or skipping basics already validated. The rigour comes from the criterion test: a defined skill set, a measuring instrument with real examples, and training repeated on failed items until everyone meets the same level, which equalises proficiency across participants and makes their errors attributable to the design rather than to unfamiliarity. Observing the training itself also shows how people learn the product.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Latent
- Stage
- Design, Evaluation
- Data
- Mixed
- Effort
- Weeks
Steps
- Define the knowledge and skills of the target experience level, for example a user one week into using the product.
- Build a criterion test or 'check yourself' quiz using realistic examples that measures that level.
- Build a training package (self-paced, instructor-led or online); two to three hours can often reach a week-old level.
- Give the criterion test, train only on the failed items and retest until each participant meets the criterion.
- For very simple products, add a forgetting gap of a few days to a week between training and test.
- Run the usability test with harder, more advanced tasks than you would give novices.
- If others deliver the training, rely on the criterion test for consistency, and optionally observe the training informally to learn how people learn.
Sources
- Handbook of Usability Testing (Rubin & Chisnell, 2008)
Also known as
- Criterion-trained participants
- Simulated experienced users
- Learning-curve acceleration for usability tests
Categories
- User Research
- Usability & Evaluation