Description
An ongoing programme that keeps a trained group of target users on site so that developers can run short formative tests at any point in development.
The Learning Games Lab solved the hardest part of frequent testing, getting access to target users, by running year-round 'think tanks' for young people. Youth consultants spend their days on engaging activities such as coding, animation and game design, and are pulled into 1 to 2 hour test sessions whenever a developer needs them. They are trained to review games, building a shared vocabulary for genre, challenge and flow so that feedback goes beyond 'it was boring'. Several methods run side by side: one-on-one interactions for early prototypes where a reviewer can explain missing parts, one-on-two observations where one reviewer silently watches two players, short focus groups to prime topics, a video closet, and written blogging. Developers act as testers so they see problems first-hand, while a testing manager observes the testers themselves to note leading questions and bias. Straight after each session the testers compare notes, agree what they saw, and the manager records a testers' consensus and recommendations in a testing journal for that project. The model trades some independence for speed, empathy and continuous access.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Latent
- Stage
- Design, Evaluation
- Data
- Qualitative
- Effort
- Months
Steps
- Recruit a cohort of target users for a recurring programme, with consent covering ongoing testing and recording.
- Run a daily programme of worthwhile activities and train participants in a shared vocabulary for reviewing products.
- Before each test, agree specific questions and methods with the developers and note them in the testing journal.
- Run the session with a mix of methods, for example one-on-two observation plus a short group discussion and individual reflections.
- Have a testing manager observe the testers and note their questions and biases.
- Immediately afterwards, hold a debrief where testers reconcile observations and agree recommendations.
- Record the version tested, objectives, findings and testers' consensus in the journal and track changes across versions.
Sources
- Garcia-Ruiz, M. (ed.), Games User Research: A Case Study Approach (2016)
Also known as
- Learning Games Lab model
- Game Design Think Tank
- Youth consultant panel
- One-on-two observation
Categories
- User Research
- Usability & Evaluation