Description
Measures performance costs when information arrives through two senses at once, revealing when audio, visual and haptic channels help or hinder each other.
Multiple resource theory predicts less interference across modalities, but cross-modal interference still occurs, especially when signals conflict in meaning or spatial location, compete for central processing, or capture attention involuntarily (auditory onsets are particularly hard to ignore). Spence and colleagues showed spatial co-location of cues across modalities improves performance while mismatched locations impair it. Measurement uses controlled paradigms in which participants perform a primary task in one modality while signals arrive in another under congruent, incongruent and neutral conditions, recording response time and error costs. In UX this answers practical questions such as whether spoken alerts disrupt reading or whether haptic feedback conflicts with visual cues.
Attributes
- Discipline
- Cognitive Psychology & Perception
- Loss type
- Unmigrated
- Stage
- Design
- Data
- Quantitative
- Effort
- Weeks
Steps
- Define the primary task and modality and the secondary signals in other modalities.
- Construct congruent, incongruent and neutral conditions (for example spoken 'left' with a left versus right visual cue; co-located versus separated sound sources).
- Run a within-subjects study with 16-24 participants, counterbalanced, with at least 30 trials per condition.
- Compute interference cost as performance in incongruent minus congruent or neutral conditions for response time and accuracy.
- Test whether costs exceed acceptable limits (for example more than 100 ms or a 5% error increase on safety-critical responses).
- Adjust timing, spatial location or content of cross-modal signals and re-test.
Sources
- Salvendy, G. (ed.), Handbook of Human Factors and Ergonomics
- Gopinath, V., Methods Atlas
- Handbook of Human Factors & Ergonomics (Salvendy)
- Methods Atlas (Gopinath)
- The Inquiry Series, Ch 12 — Multiple Resource Theory — The Bandwidth of the Human
Also known as
- Cross-modal interference testing
- Multisensory interference measurement
Categories
- User Research
- Cognitive Psychology & Perception