Description
Asks participants to rate each task's difficulty as a ratio of a baseline task, aiming for ratio-scale usability measurement.
Magnitude estimation comes from psychophysics, where people judge stimulus intensity relative to a reference (twice as bright, half as loud). Applied to usability, participants first complete an easy baseline task assigned a value (for example 10), then rate each later task relative to it, so a task rated 40 is judged four times as difficult. The goal is a ratio scale, where differences and ratios are meaningful. Participants usually need training with simple stimuli such as line lengths, and analysis uses log transformation and geometric means. Sauro and Dumas (2009) found UME was harder for participants to use and less sensitive than the SEQ or SMEQ, which is why it has largely disappeared from practice.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Extinct
- Goal
- Evaluate usability
- Stage
- Evaluation
- Data
- Quantitative
- Effort
- Hours
Steps
- Train participants on magnitude estimation with simple stimuli such as line lengths.
- Have them complete a very easy baseline task and assign it a fixed value.
- After each target task, ask for a number expressing its difficulty relative to the baseline.
- Log-transform each participant's ratings to remove individual scale use.
- Compare tasks using geometric means.
Sources
- Quantifying the User Experience (Sauro & Lewis)
Also known as
- UME
- Magnitude estimation of usability
Categories
- User Research
- Usability & Evaluation