Likert Scale Design

Description

Constructs multi-item summated attitude scales from agreement statements, with item analysis and reliability checks, to measure an attitude more validly than single questions.

Likert's original method was not a single agree-disagree question but a procedure for building a scale: write many statements about an attitude object, administer them, keep items that correlate well with the total, and sum responses into a score. Most UX surveys keep the response format and discard the procedure, using single Likert-type items and treating them as interval data. The rigorous approach defines the construct, writes balanced items, pilots them, runs item analysis (item-total correlations, Cronbach's alpha above about 0.7, ideally factor analysis), and analyses summed scales rather than individual items. Response format decisions, such as 5 versus 7 points, labelled anchors and a midpoint, should be deliberate. Single items should be analysed as ordinal, using medians and non-parametric tests or top-box proportions.

Attributes

Loss type
Vestigial
Effort
Weeks

Steps

  1. Define the construct to measure and write 10-20 candidate statements covering it, mixing positive and negative wording carefully.
  2. Choose a response format (typically 5 or 7 points with fully labelled anchors).
  3. Pilot with 50-100 respondents representative of the target population.
  4. Run item analysis: drop items with item-total correlations below about 0.3 and check Cronbach's alpha of 0.7 or above.
  5. Check dimensionality with exploratory factor analysis if the construct may have facets.
  6. Field the final scale and analyse summed scores; analyse single items as ordinal data.

Sources

  • Survey Scales
  • Quantifying the User Experience
  • A technique for the measurement of attitudes (Rensis Likert)
  • Scale Development: Theory and Applications (Robert DeVellis)
  • How to Conduct a Quantitative Usability Test (Sauro)
  • Companion Book to Quantifying the User Experience (Lewis & Sauro)
  • Quantifying the User Experience (Sauro & Lewis)
  • Gratton, C. & Jones, I., Research Methods for Sports Studies (2010)
  • Veal, A. J. & Darcy, S., Research Methods in Sport Studies and Sport Management (2014)

Also known as

  • Likert Scales
  • Likert-type items
  • Summated rating scales

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics