Active UX Surveillance

Description

Periodically assesses representative user populations with standard task batteries, exposure measures and harm reports to estimate UX harm missed by logs.

Active surveillance collects data specifically for monitoring, through surveys, structured observations and periodic studies of representative samples, and captures conditions passive systems miss: behavioural risk factors and diffuse harms not tied to clinical records. The treatise proposes active UX surveillance: periodic structured assessment of representative populations, measuring failure rates on standard task batteries, exposure to specific patterns and reported harms. It argues this is expensive but no more so than routine national health surveys. Representative sampling, standardised instruments and repeated waves allow prevalence estimates, trends and demographic distributions comparable across products and over time.

Attributes

Loss type
Unmigrated
Stage
Post-launch
Data
Mixed
Effort
Months

Steps

  1. Define the population and draw a representative sample (probability panel or weighted quota).
  2. Develop a standard task battery and validated harm and exposure questionnaires.
  3. Administer in waves (for example annually) with consistent protocols.
  4. Weight data to the population and estimate prevalence with CIs.
  5. Analyse distribution by demographics and trends over time.
  6. Publish findings and feed into interventions and regulation.

Sources

  • Lost Methods in UX — A Complete Treatise (Gopinath)
  • CDC Behavioral Risk Factor Surveillance System (BRFSS) methodology
  • Groves RM et al. (2009) Survey Methodology. 2nd ed

Also known as

  • Population UX surveys
  • Structured population studies

Categories

  • Epidemiology & Population Health