Instant Data Analysis

Description

Run all test sessions in one day and identify problems in a team meeting straight after, from a note-taker's notes rather than video.

Video-based analysis of usability tests can take days per session. Instant Data Analysis compresses it: all sessions (typically four to six) run on one day, with a moderator who also analyses and a dedicated note-taker; no screen or video recordings are analysed. Immediately after the last session the team meets, walks through the notes to jog fresh memory, discusses what users experienced and agrees which problems to report, documenting them the same day. In the original comparison it found 85% of the critical problems a full video analysis found, in a fraction of the time, but missed many low-severity problems. Rigour rests on good notes, the shortest possible gap between sessions and analysis, and a structured walkthrough of each session in the meeting.

Attributes

Loss type
Renamed
Stage
Evaluation
Effort
Days

Steps

  1. Schedule all sessions on one day, typically four to six participants.
  2. Assign a moderator who will also analyse and a dedicated note-taker.
  3. Run the sessions with detailed time-stamped notes.
  4. Meet immediately after the last session, usually for one to two hours.
  5. Walk through the notes session by session, discuss and agree the problem list with severity.
  6. Document the problems the same day.

Sources

  • Usability Testing: A Practitioner's Guide (Hertzum, 2020)

Also known as

  • IDA
  • Same-day test analysis

Categories

  • User Research
  • Usability & Evaluation