Worth-Centred Evaluation

Description

Judge whether an interaction was worthwhile by weighing its costs against achieved benefits, mapping system attributes to outcomes, and instrumenting designed benefits and adverse outcomes directly.

Cockton argues that asking whether a system is usable has little value; the useful question is whether the interaction was worth it, whether achieved benefits justified the costs. Usability is redefined as a hygiene factor: the extent to which negative experiences and outcomes reduce achievable worth. Evaluation lists problems with their time and emotional costs, and positive outcomes with present and future value, then judges worth and how to raise it, which often shows that re-engineering a whole path beats fixing individual problems. Worth maps link system attributes to user experience attributes and usage outcomes, so evaluation can target elements or connections. Direct worth instrumentation places custom measures on designed benefits and anticipated adverse interactions at every critical touchpoint of the product-service ecosystem, not only the interface, and reports unexpected positives as well as problems, across stakeholders.

Attributes

Loss type
Latent
Data
Mixed
Effort
Weeks

Steps

  1. Describe the usage episode across all devices, services and people involved.
  2. List problems and their costs in time, frustration and rework.
  3. List positive outcomes and experiences and their present and future value.
  4. Judge whether benefits justified costs and how worth could be increased: reduce costs, increase value or re-engineer the path.
  5. For planned evaluation, build a worth map linking system attributes, experience attributes and outcomes, and identify designed benefits and anticipated adverse interactions.
  6. Instrument these directly at all critical touchpoints, including offline service points.
  7. Report positives and unexpected benefits as well as problems, for all stakeholders.

Sources

  • HCI Encyclopedia (Soegaard & Dam, 2014)

Also known as

  • Worth-focused evaluation
  • Worth mapping
  • Direct worth instrumentation
  • Cost-benefit worth judgement

Categories

  • User Research
  • Usability & Evaluation