Single Ease Question (SEQ) Benchmarking

Description

A single seven-point post-task question on difficulty, benchmarked against published norms to compare tasks, designs and releases quickly.

The Single Ease Question asks, immediately after each task, 'Overall, how difficult or easy was this task to complete?' on a seven-point scale from very difficult to very easy. Sauro and Dumas found it performed as well as or better than more complex post-task instruments while taking seconds to administer. Its real value emerges when scores are interpreted against norms (the historical average is roughly 5.5) and reported with confidence intervals, enabling meaningful comparison between tasks, designs and releases. Low scores flag tasks for diagnostic follow-up, and pairing SEQ with completion and time data reveals mismatches between perceived and actual difficulty. Rigour lies in consistent wording, administration timing and sample sizes adequate for the precision required.

Attributes

Loss type
Active
Stage
Evaluation
Effort
Hours

Steps

  1. Administer SEQ immediately after each task (before the next task begins — memory decay is rapid).
  2. Score: 1=Very Difficult, 7=Very Easy.
  3. Compute: mean SEQ per task, % scoring 5–7 (top box).
  4. Benchmarks (from Sauro's database): > 5.5 mean = good; < 4.5 = poor.
  5. Correlate SEQ with task completion: expect r ≈ 0.5–0.7 between success and SEQ.
  6. Discrepancies (high success + low SEQ) reveal effortful completion.

Sources

  • Measuring the User Experience — Tullis & Albert
  • How to Conduct a Quantitative Usability Test (Sauro)
  • Benchmarking the User Experience (Sauro)
  • Companion Book to Quantifying the User Experience (Lewis & Sauro)
  • Quantifying the User Experience (Sauro & Lewis)

Also known as

  • SEQ
  • Post-task ease rating

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics