Unobtrusive Measures (Physical Traces and Archives)

Description

Infers behaviour from traces people leave without being studied (wear, accumulations, archives, workarounds), avoiding reactivity of interviews and observation.

Webb and colleagues catalogued nonreactive measures: erosion (wear on floor tiles in front of exhibits indicating popularity), accretion (fingerprints on glass, notes stuck to monitors), running records (archives, logs) and episodic records. Their argument for multiple operationalism held that every method has biases, and nonreactive traces triangulate reactive self-reports. In digital UX, logs are the obvious descendant, but physical and informal traces (sticky notes with passwords, laminated cheat sheets, printouts, home-made labels on devices, worn keys) are rich, unreactive evidence of design failures and workarounds, routinely overlooked.

Attributes

Loss type
Extinct
Stage
Discovery
Data
Mixed
Effort
Days

Steps

  1. Identify the behaviours of interest and brainstorm traces they would leave (physical, digital, documentary).
  2. Seek access to settings and archives ethically, including consent where traces are personal.
  3. Systematically document traces with photographs, counts and location, using a coding scheme.
  4. Assess biases of each trace (selective survival, deposit bias) as Webb et al. recommend.
  5. Triangulate traces with interviews and logs.
  6. Interpret traces as evidence of needs, workarounds and design failures.

Sources

  • Webb, Campbell, Schwartz & Sechrest, Unobtrusive Measures: Nonreactive Research in the Social Sciences (1966)
  • Lee, Unobtrusive Methods in Social Research (2000)
  • Yin, R., Qualitative Research from Start to Finish, 2nd ed. (2016)
  • Gratton, C. & Jones, I., Research Methods for Sports Studies (2010)
  • Veal, A. J. & Darcy, S., Research Methods in Sport Studies and Sport Management (2014)

Also known as

  • Unobtrusive measures
  • Nonreactive research
  • Erosion and accretion measures
  • Trace measures

Categories

  • User Research
  • Field & Ethnographic