Description
Tagging each piece of evidence by how many filters stand between the researcher and the event, so that reported and hearsay accounts are corroborated before they carry weight.
Yin lists this as one of five practices that apply to every mode of qualitative data collection. Firsthand evidence is what the researcher sees or hears directly. Secondhand evidence passes through one filter: a participant tells you what happened (though the fact that they said it is firsthand evidence of their account). Thirdhand evidence passes through two filters: someone tells you what another person said, or a news article quotes someone about an event. Yin does not ask researchers to discard second- and thirdhand material, since no study can observe everything, but to avoid relying on it alone and to seek corroboration from another source, which leads into triangulation. He pairs it with checks such as confirming that an interviewee was actually present at events they describe. In UX research much evidence is filtered: support agents relaying customer complaints, managers describing what their teams do, sales notes about why deals were lost. Marking each claim's remoteness during note-taking and synthesis makes it visible which findings rest on observed behaviour and which on reports of reports, and directs follow-up work to corroborate the latter.
Attributes
- Discipline
- Research Design & Rigor
- Loss type
- Latent
- Stage
- Discovery, Definition
- Data
- Qualitative
- Effort
- Hours
Steps
- Define the three levels for the team with examples from the study domain
- While taking notes, tag each claim as firsthand (observed), secondhand (reported by a participant) or thirdhand (reported about someone else's report)
- For secondhand claims, check whether the participant was present at the event they describe
- During synthesis, list which key findings rest only on second- or thirdhand evidence
- Seek corroborating sources, such as direct observation, logs or documents, for those findings
- In the report, state the evidence level behind each key finding
Sources
- Yin, R., Qualitative Research from Start to Finish, 2nd ed. (2016)
Also known as
- Evidence remoteness coding
- Primary, secondary and tertiary evidence
- Filtered evidence grading
Categories
- Research Operations
- Research Design & Rigor