Description
Script every step the moderator performs, in order, and run the full session once with colleagues to debug equipment, instructions, materials and timing before real participants arrive.
The protocol lists all procedures in order: welcome, forms, instructions, activity steps, debrief and payment. It keeps sessions consistent across days and moderators, ensures nothing is forgotten (an unsigned NDA, an unpaid participant), supports ethics review and allows replication. The pilot is mandatory even for experts and is debugging rather than practice: run it exactly as planned to set camera angles and microphones, check that instructions and questions are understood, catch typos and prototype glitches, rehearse moderation and confirm the session fits its slot. Colleagues are not real users, so the pilot tests the procedure rather than the product. Hand over moderation to an experienced colleague if the method is new to you and you are not ready.
Attributes
- Discipline
- Research Design & Rigor
- Loss type
- Active
- Stage
- Discovery, Evaluation
- Data
- Qualitative
- Effort
- Hours
Steps
- Write the protocol from arrival to payment, including exact wording for instructions and scripted prompts.
- Rehearse it with any co-moderator or note-taker and agree roles.
- Run a full pilot with colleagues or a friendly participant exactly as planned, including recording.
- Check recording quality, clarity of instructions and tasks, prototype glitches and timing against the slot.
- Revise materials and protocol, and repeat the pilot if changes are substantial.
- Use the same protocol for every session and log any deviations.
Sources
- Understanding Your Users (Baxter et al., 2015)
- Benchmarking the User Experience (Sauro, 2018)
- Handbook of Usability Testing (Rubin & Chisnell, 2008)
- Usability Engineering (Nielsen, 1993)
Also known as
- Session protocol and pilot run
- Moderator protocol
- Session script
- Dry run
- Pilot session
Categories
- Research Operations
- Research Design & Rigor