SNR measurement

Description

Quantifies the ratio of task-relevant signal to irrelevant noise in a display, alert stream or notification channel, to show where meaning is being drowned.

In engineering, SNR is signal power divided by noise power, often in decibels (10 log10 S/N). Applied to interfaces it takes two forms. Physical SNR measures, for example, alarm loudness above ambient noise or luminance contrast of a target against its background. Informational SNR measures the proportion of actionable to non-actionable items in a stream: actionable alerts over total alerts, task-relevant pixels over total pixels, or relevant results over results shown. Both connect to Shannon's capacity theorem, which shows the information a channel can carry rises with log(1 + S/N). The method is rigorous when signal and noise are defined operationally before counting, and when measurements are taken in realistic conditions rather than in a quiet lab.

Attributes

Loss type
Latent
Effort
Days

Steps

  1. Define what counts as signal (actionable, task-relevant) and noise (irrelevant, redundant, non-actionable) for the channel in scope.
  2. For physical channels, measure levels in situ: alarm SPL versus ambient noise (aim for at least 10 dB above ambient), or luminance contrast (WCAG minimum 4.5:1 for text).
  3. For informational channels, sample at least one representative week of alerts, notifications or results and code each item as signal or noise using two coders; target Cohen's kappa of 0.7 or higher.
  4. Compute SNR per channel and per user role, and in decibels where useful.
  5. Identify the largest noise contributors (Pareto: often 20% of alert types produce 80% of noise).
  6. Remove, batch or demote noise sources and recompute SNR after the change.

Sources

  • Van Drongelen, W., Signal Processing for Neuroscientists
  • MacKay, D. J. C., Information Theory, Inference, and Learning Algorithms (2003)
  • Gopinath, V., Forward-Thinking Playbook
  • Van Drongelen (Signal Processing for Neuroscientists)
  • MacKay
  • Forward-Thinking Playbook (Gopinath)
  • The Inquiry Series, Ch 2 — Signal, Noise & the Detection of Intent

Also known as

  • Signal-to-noise ratio audit
  • Interface SNR audit
  • Information SNR analysis

Categories

  • Information Theory, Physics & Mathematics