Cooper-Harper Rating Scale

Description

A decision-tree rating scale in which evaluators answer sequential yes/no questions about controllability and adequacy before assigning a 1-10 rating.

Cooper-Harper was designed for test pilots to rate aircraft handling qualities. Instead of asking for a number directly, the scale leads raters through a decision tree: Is it controllable? Is adequate performance attainable with tolerable workload? Is it satisfactory without improvement? Only then do they choose among three descriptors in the relevant branch. This anchoring produces highly consistent ratings and clear thresholds, with ratings of 4 and above indicating deficiencies that warrant improvement and 7 and above major deficiencies. The Modified Cooper-Harper version adapts it to cognitive workload for non-control tasks. The decision-tree structure is a valuable model for any UX rating that needs reliable, actionable categories.

Attributes

Loss type
Extinct
Stage
Evaluation
Effort
Days

Steps

  1. Define the task, performance standards (desired and adequate) and the conditions under which it is rated.
  2. Have expert or trained raters perform the task under each design condition.
  3. Administer the decision tree immediately after each trial, following the yes/no questions in order.
  4. Record the final 1-10 rating and the rater's comments explaining deficiencies.
  5. Compare designs by median rating and by the proportion of ratings falling in 'deficiency warrants improvement' (4-6) or 'major deficiencies' (7-9).
  6. Use comments to diagnose the specific causes of poor ratings.

Sources

  • Cooper & Harper, The use of pilot rating in the evaluation of aircraft handling qualities (1969), NASA TN D-5153
  • Wierwille & Casali, A validated rating scale for global mental workload measurement applications (1983), Human Factors Society

Also known as

  • Cooper-Harper handling qualities rating
  • Modified Cooper-Harper (MCH)

Categories

  • Accessibility
  • Human Factors & Error