Description
Multi-session study tracking task time, errors, strategies and mental models as users progress from novice to expert, fitted to learning curves.
Most usability tests capture first-use performance only. A learning study brings participants back over six to ten sessions across weeks, using a standard task battery plus novel transfer tasks. Task time is fitted to the power law of practice (T = a n^-b), giving estimates of initial difficulty and learning rate; errors, verbalisation (which falls as skills automate) and strategy shifts are tracked alongside. Mental models are probed at intervals by asking participants to explain how the system works. The result distinguishes products that are hard at first but efficient for experts from those that plateau, identifies early struggles that predict abandonment, and reveals expert strategies novices never discover.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Latent
- Stage
- Evaluation
- Data
- Mixed
- Effort
- Weeks
Steps
- Multi-session design: 6–10 sessions per participant over 2–4 weeks. Standardised task battery + novel transfer tasks per session.
- Track across sessions: Task time (model as power function T=a·n^−b), error rate, strategy shifts, verbalisation rate (automatisation decreases verbalisation).
- Mental model probing: After sessions 1, 3, 6, and 10: 'How would you explain how this works to someone new?' Track model evolution.
- Strategy transition documentation: Note when participants shift from novice strategies (exploratory, high-verification) to expert strategies (direct, minimal checking).
- Analysis: Fit learning curves. Identify early struggles predicting abandonment; habituation speed for key workflows; expert strategies novices never develop without explicit support.
Sources
- User Research (Marsh)
- Handbook of Longitudinal Research
- Handbook of Cognitive Task Design (Hollnagel)
- Mechanisms of Skill Acquisition and the Law of Practice (Newell & Rosenbloom)
Also known as
- Learnability study
- Learning curve study
- Novice-to-expert study
Categories
- User Research
- Usability & Evaluation