Momentary Item Writing and ESM Questionnaire Construction

Description

Write short, state-focused items with explicit time references and assemble them into a brief repeated questionnaire whose order, branching and length limit bias and burden.

Momentary items must capture states, not traits: adding 'right now' to a trait question does not make it momentary. 'Right now' suits states; 'since the last beep' suits rare, ongoing or hard-to-report events. Mixing references changes meaning, turning a concurrent association into a prospective one. The item checklist: short; no extreme wording; consider implicit rather than explicit assessment; avoid negatives and jargon; no reflective questions; relevant in every context the participant may be in. For assembly, put transient states first and context last, consider randomising within groups, group items by time frame and scale, and aim for under three minutes. Branches should be equally long so participants cannot shorten the survey by answering strategically; alternatives are adaptive follow-ups or planned missing designs. Control items (pain, whether a question bothered the participant) help detect reactivity. Ask about states and contexts separately and model their association rather than asking compound questions.

Attributes

Loss type
Unmigrated
Stage
Design, Discovery
Effort
Days

Steps

  1. Define each construct as a state with its time scale.
  2. Choose 'right now' or an interval reference ('since the last beep') per item, and align references for items you will relate concurrently.
  3. Word items against the checklist (short, no extremes, no negatives or jargon, no reflection, relevant in all contexts) and test wording with the target population.
  4. Choose response scales and use them consistently across items.
  5. Order items from transient states to context, and decide on randomisation within groups.
  6. Keep completion under about three minutes using equal-length branching, adaptive follow-ups or a planned missing item subset.
  7. Add control and reactivity items, pilot, and check that items show within-person variance.

Sources

  • The Open Handbook of Experience Sampling Methodology (Myin-Germeys & Kuppens, 2022)

Also known as

  • ESM item design
  • Momentary questionnaire design

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics