Description
Use a cover story only when disclosure would change the behaviour studied, then debrief with general-to-specific questions that detect suspicion and restore participants' trust.
Some behaviour cannot be studied if participants know the hypothesis, for example security behaviour: in one HCI study, people role-playing with test accounts behaved less securely than those using their own. Deception is justified only when disclosure would invalidate results, risk is minimal, and ethics approval is obtained. The funnel debriefing closes the study. A standard prompt invites honest, negative feedback with no penalty; questions move from general (how did the study go, anything odd?) to specific (what was it about, did you suspect anything?), and participants cannot return to edit earlier answers. Anonymous self-administered forms and graded suspicion scales draw more admissions than face-to-face yes/no questions; fewer than one in five deliberately informed participants admit it otherwise. The deception is then revealed, explained and discussed, and participants may withdraw their data. Evidence shows a full funnel debriefing removes negative effects on mood and trust.
Attributes
- Discipline
- Research Design & Rigor
- Loss type
- Siloed
- Stage
- Evaluation
- Data
- Mixed
- Effort
- Weeks
Steps
- Establish that disclosure would invalidate results and that no non-deceptive design would work.
- Design the cover story to minimise risk and distress, and obtain ethics approval, working with the board if prior consent is impossible.
- Run the study, then deliver a standard opening prompt inviting honest, negative feedback with no effect on payment.
- Ask general then increasingly specific questions about purpose and suspicion, preferably on an anonymous form with graded ratings, without allowing earlier answers to be edited.
- Reveal and explain the deception and why it was needed, and offer withdrawal of data.
- Pre-set exclusion thresholds for suspicion, and analyse and report results with and without aware participants.
Sources
- Research Methods in HCI (Lazar et al., 2017)
- Cambridge Handbook of Research Methods (Nichols & Edlund, 2023)
- Exploring the Ethics and Psychological Impact of Deception in Psychological Research (Boynton et al., 2013)
- MIT Psychology (Stangor, 2012)
Also known as
- Deception with debriefing in HCI studies
- Deceptive study design
- Cover story with debriefing
- Funnel debriefing
- Suspicion probe
- Post-experimental inquiry
- Awareness probe
Categories
- Research Operations
- Research Design & Rigor