UX Systematic Review and Meta-Analysis

Description

Synthesises all relevant UX studies using defined search, inclusion, quality appraisal and statistical pooling to estimate effects and explain heterogeneity.

Systematic reviews and meta-analyses are the gold standard of evidence synthesis in medicine, giving more reliable effect estimates than single studies and identifying sources of heterogeneity. The treatise notes UX has a large research literature never systematically reviewed with epidemiological methods; existing reviews are typically narrative, without formal quality assessment or statistical pooling. Applying rigorous methods (protocol registration, comprehensive search, dual screening, risk-of-bias assessment, random-effects pooling, heterogeneity and publication-bias analysis, GRADE-style certainty ratings) would substantially improve the evidence base for design recommendations. Internally, organisations can meta-analyse their own experiments and studies.

Attributes

Loss type
Unmigrated
Stage
Strategy
Effort
Months

Steps

  1. Write and register a protocol (question, PICO, inclusion criteria, outcomes).
  2. Search databases and grey literature comprehensively; document the search.
  3. Screen and extract data with two independent reviewers.
  4. Assess risk of bias for each study.
  5. Pool effects with random-effects meta-analysis; analyse heterogeneity and publication bias.
  6. Grade certainty of evidence and report following PRISMA.

Sources

  • Lost Methods in UX — A Complete Treatise (Gopinath)
  • Higgins JPT et al. (Eds) (2023) Cochrane Handbook for Systematic Reviews of Interventions
  • Page MJ et al. (2021) The PRISMA 2020 statement. BMJ
  • Borenstein M et al. (2009) Introduction to Meta-Analysis
  • Page et al., The PRISMA 2020 statement (2021), BMJ
  • Higgins et al. (eds.), Cochrane Handbook for Systematic Reviews of Interventions (2019)
  • Petticrew & Roberts, Systematic Reviews in the Social Sciences (2006)
  • Veal, A. J. & Darcy, S., Research Methods in Sport Studies and Sport Management (2014)

Also known as

  • Systematic review
  • Meta-analysis
  • Evidence synthesis
  • Systematic literature review
  • PRISMA review
  • Evidence review
  • Systematic Review (PRISMA)

Categories

  • Epidemiology & Population Health