SMEQ (Subjective Mental Effort Question)

Description

A single post-task rating of mental effort on a 0 to 150 scale with calibrated verbal anchors, one of the most sensitive post-task measures.

The SMEQ is a vertical scale from 0 to 150 with nine verbal labels from "not at all hard to do" just above 0 to "tremendously hard to do" just above 110. The labels were placed by psychometric calibration rather than at equal intervals. On paper, participants draw a line across the 150 mm scale; online, they use a slider. Sauro and Dumas (2009) found it correlated 0.94 with the SEQ and strongly with completion time, completion rate and errors, and in their comparison it was at least as sensitive as the SEQ with small samples. It is free and works well when you want a finer-grained measure of task difficulty than a 7-point item.

Attributes

Loss type
Siloed
Stage
Evaluation
Effort
Hours

Steps

  1. Present the SMEQ scale immediately after each task.
  2. Ask participants to mark or slide to the level of mental effort the task required.
  3. Record the value from 0 to 150.
  4. Compare task means with confidence intervals, as for any continuous measure.
  5. Look at tasks with high effort but successful completion: they are hidden friction.

Sources

  • Quantifying the User Experience (Sauro & Lewis)

Also known as

  • SMEQ
  • RSME (Rating Scale for Mental Effort)

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics