Description
Measure efficiency as meaningful actions per successful task, or as task completion rate divided by mean time, to compare designs on effort per unit of success.
Efficiency combines the effort spent with the outcome achieved. Action counting follows five rules: identify which actions to count (clicks, page views, keystrokes, screens); define where each action starts and ends; count with a logger, tool or video; make sure each counted action is a meaningful step towards the goal; and count only successful tasks. Results are reported as mean actions per task with confidence intervals, or as the share of participants exceeding the minimum path. The Common Industry Format's core efficiency measure divides task completion rate by mean time per task, with a time unit chosen so most values fall between 1% and 100%; a per-participant variant divides tasks completed successfully by total time on all tasks. Because a ratio hides whether low efficiency comes from failure or slowness, both components should be reported.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Vestigial
- Stage
- Evaluation
- Data
- Quantitative
- Effort
- Days
Steps
- Choose the effort unit (clicks, page views, keystrokes, screens) or use time.
- Define the start and end of each action and each task.
- Record actions with a logger, an unmoderated testing tool or video.
- For action counts, keep successful tasks only and compute mean actions per task with confidence intervals, or the percentage exceeding the minimum path.
- For the CIF ratio, compute completion rate divided by mean time per task, or per participant tasks completed divided by total time, choosing a time unit that keeps values between 1% and 100%.
- Compare designs with t-tests or ANOVA on per-participant values and report success and time alongside the ratio.
Sources
- Measuring the User Experience (Albert & Tullis, 2022)
Also known as
- Efficiency metrics: action counts and task success per unit time
- Action-count efficiency
- Steps per task
- ISO/IEC 25062 core efficiency
- Tasks completed per minute
Categories
- User Research
- Usability & Evaluation