User Engagement Scale (UES)

Description

A 31-item questionnaire measuring engagement on six subscales (focused attention, perceived usability, aesthetics, endurability, novelty, felt involvement), with a 12-item short form.

O'Brien and Toms developed the User Engagement Scale from a model of engagement as a quality of experience. The original 31 items cover six subscales: Focused Attention, Perceived Usability, Aesthetics, Endurability, Novelty and Felt Involvement. It is administered after the experience on a Likert scale, and domain adaptations exist, such as Wiebe et al.'s version for games. Landa-Avila and Cruz reworded items for a VR gesture game, translated them into Spanish, administered them on a seven-point scale to 164 visitors at a technology event, and checked reliability with Cronbach's alpha, inter-subscale correlations and oblique factor analysis. Endurability, Novelty and Felt Involvement overlapped (r above 0.7) and loaded together, echoing later work that collapsed the scale to four factors in the 12-item UES-SF. Any adaptation should be revalidated.

Attributes

Loss type
Siloed
Stage
Evaluation
Effort
Days

Steps

  1. Start from the UES-SF (12 items) or the long form, or an existing domain adaptation.
  2. Reword and, if needed, translate items for the context, keeping meaning; back-translate where possible.
  3. Administer immediately after the experience on the original Likert scale.
  4. Compute subscale scores and Cronbach's alpha per subscale (aim for 0.70 or more).
  5. Inspect inter-subscale correlations and run factor analysis with oblique rotation (sample of 150 or more) to check the structure holds.
  6. Compare subscale scores across designs or versions and triangulate with behavioural engagement data.

Sources

  • DUXU 2017: Designing Pleasurable Experiences (Marcus & Wang, 2017)

Also known as

  • UES
  • O'Brien and Toms engagement scale
  • UES-SF

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics