Description
Captures readers' real-time processing of a document through think-aloud protocols to locate comprehension failures and predict revisions that improve understanding.
Document design research studied how the visual organisation of text and graphics affects comprehension and usability, and by the 1980s had rigorous methods for testing comprehension, navigation and recall. The treatise singles out Karen Schriver's Dynamics in Document Design (1997) and its protocol-based evaluation methods, in which readers' processing of a document is captured in real time, as far more sophisticated than anything routinely used in content UX. In protocol-aided revision, representative readers think aloud while reading a draft; analysts code points of confusion, misreading and inference, then revise. Schriver showed that writers trained with reader protocols became markedly better at predicting readers' problems. The treatise notes content decisions today are driven by brand guidelines and intuition rather than empirical understanding of how audiences process content.
Attributes
- Discipline
- Information Architecture & Content
- Loss type
- Extinct
- Stage
- Evaluation
- Data
- Qualitative
- Effort
- Days
Steps
- Select representative readers, including low-literacy and non-native readers where relevant.
- Have each read the document or content flow while thinking aloud, with comprehension questions after.
- Transcribe and code protocols for misreadings, inference gaps, skipped sections and navigation problems.
- Locate each problem in the text and categorise by cause (wording, structure, visual hierarchy, graphics).
- Revise and re-test with new readers.
- Measure comprehension and task accuracy before and after.
Sources
- Lost Methods in UX — A Complete Treatise (Gopinath)
- Schriver KA (1997) Dynamics in Document Design: Creating Texts for Readers
- Schriver KA (1991) Plain language through protocol-aided revision. In Plain Language: Principles and Practice
- De Jong M & Schellens PJ (1997) Reader-focused text evaluation. J Business and Technical Communication
Also known as
- Reader protocol evaluation
- Document design research
- Plus-minus method (related)
Categories
- Content
- Information Architecture & Content