Description
Participants predict an experience before it happens and record the reality afterwards; the gap measures mental model accuracy, with a pre-mortem variant for risks.
This protocol pairs a prediction entry before a task with an experience entry immediately after. Participants say what they expect will happen, what will be easy or hard, and how long it will take; afterwards they report what actually happened. The gap between prediction and experience is the data: it locates inaccurate mental models, system behaviour users find systematically surprising, and miscalibrated confidence. The pre-mortem variant, adapted from Gary Klein's project risk technique, asks experienced users to imagine that a new feature has failed after six months and explain why, generating a risk inventory before launch. Both make expectations explicit rather than inferred after the fact.
Attributes
- Discipline
- Participatory, Design & Futures
- Loss type
- Latent
- Stage
- Design, Evaluation
- Data
- Mixed
- Effort
- Days
Steps
- Prediction diary entry (before use): Before the participant begins a task or interaction, ask them to predict: "What do you think will happen? What will be easy? What will be difficult? How long do you think it will take?"
- Experience diary entry (after use): Immediately after: "What actually happened? What was easier or harder than expected? How long did it actually take?"
- Gap analysis: The gap between prediction and experience is your data. A prediction gap reveals: (a) where mental models are inaccurate, (b) where the system's behaviour is systematically unexpected, (c) where user confidence is miscalibrated.
- Pre-mortem variant: Before a new feature or redesign launches, ask experienced users to imagine that the feature has failed completely after 6 months of use. "What went wrong? Why did users stop using it?" The resulting list is your risk inventory for user research.
Sources
- User Research (Marsh)
- Validating Product Ideas (Tomer Sharon)
- Just Enough Research (Hall)
- Performing a Project Premortem (Klein)
Also known as
- Prediction diary
- Expectation-experience gap diary
- User pre-mortem
Categories
- Design
- Participatory, Design & Futures