Description
Participants report momentary experience in real time when prompted at random or event-based moments, minimising recall bias and capturing experience in context.
The Experience Sampling Method, developed by Csikszentmihalyi and Larson, and the closely related Ecological Momentary Assessment from behavioural medicine, prompt participants several times a day to report what they are doing, feeling and experiencing at that moment. Prompts may be random within time windows, at fixed intervals or triggered by events, such as app use or location. Because reports are immediate and in situ, ESM reduces recall bias and captures variation within people across contexts. Data form many short, repeated measures per person and require multilevel analysis. Rigour comes from a sampling schedule matched to the phenomenon, very short questionnaires (under about two minutes), compliance monitoring (aiming for at least 70 to 80 percent), and analysis that separates within-person from between-person variation.
Attributes
- Discipline
- Field & Ethnographic
- Loss type
- Siloed
- Stage
- Discovery, Post-launch
- Data
- Quantitative
- Effort
- Weeks
Steps
- Define the momentary experiences and contexts of interest.
- Choose signal-, interval- or event-contingent sampling and set the schedule, for example 5 to 8 random prompts per day for 7 to 14 days.
- Design a short questionnaire of validated momentary items that takes under two minutes.
- Pilot on the target platform and adjust burden.
- Recruit 20 to 50 or more participants, brief them and monitor compliance daily.
- Clean data, applying compliance and response time rules.
- Analyse with multilevel models to separate within-person and between-person effects.
Sources
- Diary Methods
- Statistics for HCI
- Experience Sampling Method (Hektner, Schmidt & Csikszentmihalyi)
- Diary Methods (Flick ed.)
- User Research (Marsh)
- Handbook of Longitudinal Research
- Validity and Reliability of the Experience-Sampling Method (Csikszentmihalyi & Larson)
- Ecological Momentary Assessment (Shiffman, Stone & Hufford)
- Lost Methods in UX — A Complete Treatise (Gopinath)
- Csikszentmihalyi M & Larson R (1987) Validity and reliability of the experience-sampling method. J Nervous Mental Disease 175:526-536
- Hektner JM, Schmidt JA & Csikszentmihalyi M (2007) Experience Sampling Method
- Shiffman S, Stone AA & Hufford MR (2008) Ecological momentary assessment. Annu Rev Clin Psychol
- Research Design (Leavy)
- Sage Handbook of Qualitative Data Collection
- Autoethnography
- The Inquiry Series, Ch 33 — Participatory & Arts-Based Methods
- Veal, A. J. & Darcy, S., Research Methods in Sport Studies and Sport Management (2014)
Also known as
- ESM
- Ecological Momentary Assessment
- EMA
- Beeper studies
- Signal-contingent sampling
- Experience Sampling Method (ESM)
- Experience Sampling Method (ESM/EMA)
- Diary study
- Experience sampling
- Longitudinal self-report
- Diary methods
- Structured diary design
- Experience Sampling Diary Design
Categories
- User Research
- Field & Ethnographic