Survey Climate Assessment

Description

Monitoring a population's willingness to take part in surveys through standardised response rates, recorded refusal reasons and a short attitude-to-surveys scale.

Survey climate is the general disposition of a population towards taking part in surveys. It is assessed through indicators computed identically over time: standardised response rates from consistent contact forms, refusal reasons recorded as paradata, and a short scale measuring opinions about surveys. Loosveldt and Storms developed a five-dimension, 23-item measure with a six-item short form (usefulness, waste of time, keeping people from important things, boring, dislike of participating, invasion of privacy), with a reported alpha of 0.82. The method's distinctive caution is that surveys about surveys are biased towards favourable views, because people who answer them like surveys more than those who do not; a mixed-mode or self-administered follow-up is used to estimate that bias.

Attributes

Loss type
Unmigrated
Effort
Weeks

Steps

  1. Compute response rates identically across waves and groups, using standardised outcome codes and contact records.
  2. Record reasons for refusal and break-off as paradata.
  3. Field the six-item opinions-about-surveys short scale at the end of a regular survey.
  4. Use a follow-up in another mode or with nonrespondents to estimate selection bias in the attitude results.
  5. Track the indicators by segment and over time, and relate changes to survey load and contact policy.

Sources

  • The SAGE Handbook of Survey Methodology (Wolf et al., 2016)

Also known as

  • Survey climate
  • Surveys on surveys
  • Attitudes toward surveys scale
  • Opinions about surveys short scale
  • Survey fatigue monitoring

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics