Description
Having a sizeable group of target players play to a time or in-game point and then answer survey questions about their attitudes and experience.
In games user research, playtesting is distinguished from usability testing. Usability asks whether players can do and understand things; playtests ask what players think and feel, for example how fun a level is, whether the pace is right or how they rate the graphics. Because the data are attitudes, playtests need larger samples than usability tests, ideally around 30 players per group if parametric comparisons are planned. Participants play for a set time or until a given in-game event, stop and answer a survey, then resume, repeating this two or three times. A key skill is translating research questions (what the team wants to know) into playtest questions (what players are asked): closed rating items such as satisfaction with the art style, and paired open questions asking what players liked most and least. Teams work out research questions by playing the game themselves and listing what target players may like, dislike, find easy or difficult. Analysis compares groups with t-tests, ANOVA or non-parametric equivalents. Many sessions can be run in parallel in a lab with several stations.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Active
- Stage
- Evaluation
- Data
- Mixed
- Effort
- Days
Steps
- Define research questions about player attitudes, informed by earlier heuristic and usability findings.
- Write playtest questions for each research question: closed rating items plus 'liked most' and 'liked least' open items.
- Recruit target players, enough for planned group comparisons.
- Set play segments by time or in-game event, with survey breaks between segments.
- Run sessions, often several players in parallel, collecting survey responses at each break.
- Analyse ratings by segment and group with suitable tests and code open answers.
- Report findings against research questions with recommendations.
Sources
- Garcia-Ruiz, M. (ed.), Games User Research: A Case Study Approach (2016)
Also known as
- GUR playtest
- Survey-based playtest
- Playtest
Categories
- User Research
- Usability & Evaluation