Visual Layout and Web Design of Self-Administered Questionnaires

Description

Laying out paper or web questionnaires so words and graphics together lead every respondent through each item in the intended order, reducing nonresponse, branching errors and mode differences.

Questionnaires speak two languages, words and graphics. The method defines a navigational path for each page or screen and uses location, size, brightness, shape, regularity and a consistent figure/ground format to keep respondents on it, with stronger visual interruptions where they must branch. Dillman gives 28 construction principles for paper (question numbers, contrast between questions and answers, vertical answer lists, consistent box placement, even scale spacing) and 23 for web and e-mail (welcome screen, first question, cross-browser testing, restrained drop-downs, no forced responses, progress indicators). Experiments show arrows, spacing, subheadings, symbols and answer box sizes change what people answer, and that forced-choice yes/no items outperform check-all boxes. A variant for item batteries, the carousel, shows one item at a time with automatic advance under a fixed stem and scale, reducing straightlining relative to grids.

Attributes

Loss type
Siloed
Stage
Design
Data
Mixed
Effort
Days

Steps

  1. Choose a conventional format and define the order in which every word and symbol on each page or screen should be read.
  2. Make question starts consistent and prominent, print questions more strongly than answer choices, and leave more space between questions than within them.
  3. List answer choices vertically with boxes consistently on one side; space scale points evenly and keep scale direction constant throughout.
  4. Place instructions exactly where needed inside the question, and for skips combine two or three devices (arrows, bold skip text, an '(If yes)' lead-in, indentation of screened items).
  5. For web versions, open with a short welcome screen, make the first question easy and fully visible, test across screen sizes and browsers, label drop-downs, avoid forcing answers and show simple progress.
  6. Replace check-all-that-apply with forced-choice yes/no items; for long batteries consider a carousel format with a visible position bar and back navigation.
  7. Cognitively test the layout, and where possible compare item nonresponse or straightlining against an alternative version.

Sources

  • Mail and Internet Surveys (Dillman, 2007)
  • The SAGE Handbook of Survey Methodology (Wolf et al., 2016)

Also known as

  • Visual layout of questionnaires
  • Respondent-friendly questionnaire design
  • Navigational path design
  • Visual design of survey questions
  • Skip instruction design
  • Dillman's web survey design principles
  • Online questionnaire design guidelines
  • E-mail survey design
  • Carousel question format
  • Auto-advance grid alternative

Categories

  • Analytics & Behaviour
  • Survey & Psychometrics