Description
Before trusting stated preferences on unfamiliar or complex issues, audit how the question's definition, perspectives and cues could shape answers, then ask in several ways and treat disagreement as data.
People hold clear values mainly on familiar, simple, directly experienced matters. On unfamiliar issues they may have no opinion, an incoherent one or access only part of it, and the elicitor's choices fill the gap. Fischhoff, Slovic and Lichtenstein list the ways this happens: defining the issue (whether a problem exists, which options and consequences are named, labels, measures and decomposition), controlling perspectives (salience, importance, timing, confidence cues) and changing the respondent by creating, deepening or destroying views. Psychophysical factors such as range, order, anchors and category labels add further lability. Their remedy is methodological pluralism: pose deliberately different formulations and analyse the variation, and, when considered values matter, use interactive elicitation that helps respondents think through the issue and records how views change.
Attributes
- Discipline
- Survey & Psychometrics
- Loss type
- Latent
- Stage
- Discovery, Definition
- Data
- Mixed
- Effort
- Days
Steps
- Judge whether respondents are likely to have no opinion, an incoherent one or a coherent one on the issue.
- Walk through the checklist: issue definition, options and consequences named or omitted, labels, response scale, decomposition, salience and importance cues, timing and confidence cues.
- Check psychophysical factors: response range, question order, anchors and category labels.
- Write several deliberately different formulations of the value question and field them to random subsamples.
- Analyse the spread of answers across formulations and report it rather than a single figure.
- Where considered values are needed, run interactive sessions offering alternative perspectives and record how views shift.
Sources
- Decision Making: Descriptive, Normative, and Prescriptive Interactions (Bell et al., 1988)
Also known as
- Labile values checklist
- Value elicitation audit (Fischhoff, Slovic and Lichtenstein)
- Methodological pluralism for value elicitation
Categories
- Analytics & Behaviour
- Survey & Psychometrics