Tailored Design Method

Description

A planned sequence of contacts, reminders and replacement questionnaires, plus attention to letter, design and incentives, to raise self-completion survey response rates.

Response to self-completion surveys depends on the topic, the questionnaire's length and presentation, the covering letter, the ease of reply, rewards and, above all, reminders. Veal and Darcy call well-planned follow-ups perhaps the most important tool available, and reproduce Dillman's sequence: the initial mailing with the questionnaire; a postcard reminder after about a week; a reminder letter with a second copy of the questionnaire, 'in case the original has been mislaid', after about two weeks, possibly offering a telephone interview; and a final reminder after about three weeks. Email or phone can replace post. In their example of a residents' survey, returns would have stopped at about 40 per cent, but surges after each reminder lifted the final rate to 75 per cent. Reminders require responses to be identifiable, which raises confidentiality concerns that can be eased by numbering the reply envelope rather than the questionnaire. Identification also lets researchers check representativeness and weight. For UX email and in-product surveys, which commonly send one invitation and accept a few per cent response, a planned follow-up schedule is a direct way to reduce non-response bias.

Attributes

Loss type
Siloed
Effort
Weeks

Steps

  1. Write a covering message that explains who is asking, why it matters and how answers will be used.
  2. Design the questionnaire to look easy to complete, with clear layout and a simple way to return it.
  3. Send the initial invitation and track who has responded with an identifier kept apart from the answers.
  4. Send a short reminder to non-respondents after about a week.
  5. After about two weeks send a fuller reminder with a fresh copy or link, and offer an alternative mode such as a short call.
  6. Send a final reminder after about three weeks, then close fieldwork.
  7. Plot daily returns, report the response rate and compare respondents with the population to judge non-response bias.

Sources

  • Veal, A. J. & Darcy, S., Research Methods in Sport Studies and Sport Management (2014)

Also known as

  • Dillman method
  • Survey follow-up and reminder protocol
  • Mail survey follow-up sequence
  • Total design method

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics