Co-Discovery (Constructive Interaction)

Description

Two participants work through tasks together and talk to each other, giving natural verbal data on reasoning in place of solo think-aloud.

Thinking aloud alone is unnatural; explaining to a partner is not. In co-discovery two participants share one device and set of tasks and are asked to work together, so each tells the other what they think is happening, what to do and why. Suchman used novice pairs in the 1980s to produce a naturally generated protocol, and O'Malley and colleagues named the approach constructive interaction. Evidence is mixed but consistent: pairs verbalise more and give more high-value statements (Hackman and Biers 1992) and find the session more pleasant, without changing performance or preferences, yet problem detection gains are small, mostly extra low-severity problems. With children, pairs of 13 to 14 who know each other work well, while 6 to 7 year olds often work alone or compete. Analysts must watch for one partner's insight masking the other's problem and for shared problems left unspoken.

Attributes

Loss type
Siloed
Effort
Days

Steps

  1. Recruit pairs of representative users, preferably acquainted, considering age, friendship and gender; budget twice the incentives.
  2. Seat the pair at one shared device in a way that does not cast either as onlooker, and give one task list.
  3. Instruct both to stay active and to talk to each other as they normally would; do not ask for think-aloud.
  4. Prompt minimally, allowing extra session time for discussion.
  5. Record speech, gestures and who controls the device.
  6. Code the dialogue for confusions, explanations and disagreements, watching for masked problems and unspoken shared ones.
  7. Report problems and reasoning; do not treat task times as individual performance.

Sources

  • HCI Encyclopedia (Soegaard & Dam, 2014)
  • The UX Book (Hartson & Pyla, 2019)
  • A Practical Guide to Usability Testing (Dumas & Redish, 1999)
  • Usability Testing: A Practitioner's Guide (Hertzum, 2020)
  • Interaction Design: Beyond Human-Computer Interaction (Preece et al., 2019)
  • Designing the User Interface (Shneiderman et al., 2018)
  • Plans and Situated Actions (Suchman, 1985)
  • Handbook of Usability Testing (Rubin & Chisnell, 2008)
  • Usability Engineering (Nielsen, 1993)

Also known as

  • Co-discovery
  • Codiscovery
  • Constructive interaction
  • Paired-user testing
  • Paired think-aloud
  • Pairwise usability test
  • Paired-user think-aloud
  • Co-discovery learning
  • Team usability testing
  • Two-participant usability test
  • Pair analytics
  • Paired first-time users as a naturally generated protocol

Categories

  • User Research
  • Usability & Evaluation