Description
Documentary filmmakers or journalists are commissioned to make their own accounts of people living with a deployed design, adding outside voices to evaluation.
Gaver's group developed cultural commentators to evaluate ludic and research-through-design prototypes for which usability metrics make little sense. After a design is deployed in people's homes or communities, independent commentators such as documentary filmmakers and journalists are hired to observe and interview the people involved and produce their own personal, interpretive accounts. Because they are not designers or HCI researchers, their non-native interpretations bring new perspectives and resist the designers' own framing, producing a polyphonic assessment in which several voices sit side by side rather than being reduced to a single verdict. The method sits alongside cultural probes as a dialogical, interpretive approach. Its rigour lies in commentators' independence and in triangulating their accounts with designers' and participants' own views.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Siloed
- Stage
- Evaluation, Post-launch
- Data
- Qualitative
- Effort
- Months
Steps
- Deploy the design with people in their everyday setting for a substantial period.
- Commission independent commentators (documentary filmmakers, journalists) with no stake in the design.
- Brief them on access and ethics but not on what to conclude.
- Let them observe, interview and produce films or articles in their own style.
- Set their accounts alongside designers' observations and participants' own views.
- Discuss agreements and tensions among the voices to inform the next design.
Sources
- Experience-Centered Design (Wright & McCarthy, 2010)
Also known as
- Non-native interpretations
- Polyphonic assessment
Categories
- User Research
- Usability & Evaluation