Description
Constructs multi-item summated attitude scales from agreement statements, with item analysis and reliability checks, to measure an attitude more validly than single questions.
Likert's original method was not a single agree-disagree question but a procedure for building a scale: write many statements about an attitude object, administer them, keep items that correlate well with the total, and sum responses into a score. Most UX surveys keep the response format and discard the procedure, using single Likert-type items and treating them as interval data. The rigorous approach defines the construct, writes balanced items, pilots them, runs item analysis (item-total correlations, Cronbach's alpha above about 0.7, ideally factor analysis), and analyses summed scales rather than individual items. Response format decisions, such as 5 versus 7 points, labelled anchors and a midpoint, should be deliberate. Single items should be analysed as ordinal, using medians and non-parametric tests or top-box proportions.
Attributes
- Discipline
- Survey & Psychometrics
- Loss type
- Vestigial
- Stage
- Definition, Evaluation
- Data
- Quantitative
- Effort
- Weeks
Steps
- Define the construct to measure and write 10-20 candidate statements covering it, mixing positive and negative wording carefully.
- Choose a response format (typically 5 or 7 points with fully labelled anchors).
- Pilot with 50-100 respondents representative of the target population.
- Run item analysis: drop items with item-total correlations below about 0.3 and check Cronbach's alpha of 0.7 or above.
- Check dimensionality with exploratory factor analysis if the construct may have facets.
- Field the final scale and analyse summed scores; analyse single items as ordinal data.
Sources
- Survey Scales
- Quantifying the User Experience
- A technique for the measurement of attitudes (Rensis Likert)
- Scale Development: Theory and Applications (Robert DeVellis)
- How to Conduct a Quantitative Usability Test (Sauro)
- Companion Book to Quantifying the User Experience (Lewis & Sauro)
- Quantifying the User Experience (Sauro & Lewis)
- Gratton, C. & Jones, I., Research Methods for Sports Studies (2010)
- Veal, A. J. & Darcy, S., Research Methods in Sport Studies and Sport Management (2014)
Also known as
- Likert Scales
- Likert-type items
- Summated rating scales
Categories
- Analytics & Behaviour
- Survey & Psychometrics