Description
A usability test in which the user may ask an expert coach any question about the system, so the questions reveal novices' information needs for documentation, training and redesign.
Most test methods minimise interference; the coaching method makes interaction the instrument. The test user works on real tasks and may ask a coach any system-related question, which the coach answers as well as possible. The coach is usually the experimenter or an assistant; a variant uses an independent expert user as coach so the experimenter can also study how the expert explains the interface and thus the expert's model of it. The main output is a catalogue of novice questions: each one marks an information need that documentation or training must meet, or that a redesign could remove. Nielsen notes it can feel more natural than thinking aloud, helped Japanese users voice problems where criticism is culturally discouraged, gives small, highly paid user groups a tangible benefit, and can bring novices up to speed before expert-performance tests. A variant restricts answers to predetermined information and varies the rules to learn which kinds of help work best.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Extinct
- Stage
- Design, Evaluation
- Data
- Qualitative
- Effort
- Days
Steps
- Recruit novice test users and a coach: the experimenter, an assistant, or an independent expert user.
- Give the user realistic tasks and tell them they may ask the coach any question about the system.
- Record every question, the context in which it arose and the coach's answer.
- Classify the questions to identify information needs and the interface features that caused them.
- If an independent coach was used, analyse their answers to model the expert's understanding of the interface.
- Feed findings into documentation, training and interface changes that would make the questions unnecessary; optionally follow with expert-performance testing.
Sources
- Usability Engineering (Nielsen, 1993)
Also known as
- Coached usability test
- Coaching method
Categories
- User Research
- Usability & Evaluation