Description
Writing targets and reporting rules into the fieldwork contract, monitoring progress by interviewer, verifying interviews with back-checks and acting when targets are missed.
When data collection is outsourced, quality depends on specifying and checking what the field team does. Targets (response rate, interviews per week, contact rules such as the ESS minimum of four in-person attempts over two weeks including an evening and a weekend) go into the call for tender. Outcomes are coded with AAPOR Standard Definitions, so response rates are calculated consistently, and rules on partial interviews, proxies and substitution are agreed. Regular reports by interviewer cover interviews, appointments, refusals, noncontacts and timing, and outcomes prone to shortcuts (looped batteries, consent items) are watched. Back-checks re-contact respondents by mail or phone to verify that interviews happened, and delivered data are checked for duplicates and inconsistencies. Agreed repercussions follow: extend fieldwork, retrain or replace interviewers. Back-checks catch only serious problems, and interviewer effects are confounded with area unless assignments are interpenetrated.
Attributes
- Discipline
- Research Design & Rigor
- Loss type
- Siloed
- Stage
- Discovery, Evaluation
- Data
- Quantitative
- Effort
- Weeks
Steps
- Write targets into the tender: response rate, weekly interview counts, contact rules and reporting frequency.
- Agree AAPOR disposition codes and rules for partial interviews, proxies and substitution.
- Require regular reports by interviewer or recruiter: completes, appointments, refusals, noncontacts, ineligibles and contact timing.
- Monitor outcomes prone to shortcuts, such as skipped loops, very short interviews or identical answer patterns.
- Back-check a random subsample by phone or all respondents by mail soon after the interview.
- Check delivered data for duplicates, speeding and inconsistencies.
- Apply agreed actions when targets are missed: extend fieldwork, retrain or replace staff, prioritise low-propensity cases.
Sources
- The SAGE Handbook of Survey Methodology (Wolf et al., 2016)
- Quantitative Social Research Methods (Singh, 2007)
Also known as
- Fieldwork monitoring
- AAPOR final disposition coding
- Interviewer back-checks
- Interviewer falsification checks
- Interviewer effects
Categories
- Research Operations
- Research Design & Rigor