Confirmability Audit

Description

Showing that each qualitative finding can be traced to specific data and documented decisions rather than to researcher preference.

Confirmability is the qualitative parallel to objectivity: findings should be shaped by participants and data, not by researcher motivations or interests. Lincoln and Guba recommended a reflexive journal alongside the audit trail. Reflexive memos record expectations before each session, surprises and emotional reactions afterwards, and moments where interpretations were influenced by prior beliefs or stakeholder pressure. During analysis, each major interpretation is checked against the memos: did the researcher expect this before seeing the data? Was disconfirming evidence noticed and recorded? Rigour comes from writing memos at the time rather than retrospectively, structuring them with consistent prompts, and having a second analyst review the link between memos and findings.

Attributes

Loss type
Latent
Stage
Definition
Effort
Days

Steps

  1. Build a findings-to-evidence table listing each finding with the specific data extracts and participants that support it.
  2. Link every major analytic decision (code merges, weighting of participants, exclusions) to a dated rationale in the memo or decision log.
  3. Keep a reflexivity journal and summarise in the report how the researcher's assumptions may have shaped interpretation.
  4. Ask a second researcher to trace a sample of findings back to raw data and to flag any inference that goes beyond the evidence.
  5. Revise or qualify findings that cannot be grounded, and report the audit outcome.

Sources

  • Naturalistic Inquiry (Lincoln & Guba)
  • Sage Handbook of Qualitative Data Analysis (Flick)
  • Naturalistic Inquiry (Lincoln & Guba) via Sage Handbook
  • Qualitative Research Ethics (Sage)
  • The Inquiry Series, Ch 27 — Lincoln & Guba — Trustworthiness in Qualitative Research

Also known as

  • Qualitative objectivity
  • Confirmability
  • Traceability audit
  • Reflexive memoing
  • Reflexive journal
  • Confirmability audit
  • Confirmability through reflexive memo

Categories

  • Research Operations
  • Research Design & Rigor