Description
Comparing people who use a system alone with people paired with a non-controlling partner, and analysing the partners' private conversation to understand social experience, learning and decision-making.
In the TableTalk Poker study, older adults were randomly assigned to solo play or partner play. In partner play, one person controlled the game while a nonplaying partner shared the same view and could only talk to their partner over a private voice channel and use the public chat. Partners were re-paired between the two four-hour sessions to mix personalities and skills. The recorded voice chats became the main data: they show, without asking anyone to think aloud, how people explain decisions, teach, negotiate and joke. Inductive analysis of these transcripts was triangulated with field notes from researchers rotating behind participants, short exit interviews, an engagement scale, a social attraction measure, a knowledge quiz before and after, and log data on betting behaviour. The design answers three questions at once: does pairing change the social experience, engagement and the quality of decisions. Formative work for the same project used a related set-up, pairing novice players with an advisor in a face-to-face game and observing the learning that resulted. For UX, the set-up is a natural way to elicit reasoning and to study shared or assisted use.
Attributes
- Discipline
- Experimentation & Causal Inference
- Loss type
- Latent
- Stage
- Evaluation
- Data
- Mixed
- Effort
- Weeks
Steps
- Define research questions about social experience, engagement and task performance.
- Randomly assign participants to solo use or partner use, and within pairs to the controlling and non-controlling roles.
- Give partners a shared view and a private, recorded voice channel; give solo participants equivalent conditions without a partner.
- Run extended sessions, re-pairing partners between sessions if appropriate.
- Collect transcripts, observation notes, logs and short questionnaires on engagement and relationship.
- Analyse transcripts inductively for themes and compare groups on logs and questionnaire measures.
Sources
- Garcia-Ruiz, M. (ed.), Games User Research: A Case Study Approach (2016)
Also known as
- Player and non-player dyad study
- Partner-play versus solo-play comparison
- Advisor-paired play observation
Categories
- Analytics & Behaviour
- Experimentation & Causal Inference