Visual world paradigm

Description

Record where people look in a scene while they hear speech, time-locked to word onsets, to measure moment-by-moment interpretation and anticipation of spoken language.

Participants view a real or pictured scene while hearing instructions or sentences, and eye movements to objects are recorded word by word. In Tanenhaus et al.'s one-apple scene ('Put the apple on the towel in the box'), people looked at the empty towel on 55 per cent of trials, treating 'on the towel' as the destination; with unambiguous wording or two apples in view, such looks fell to about 10 per cent or none, showing the scene shapes parsing from the outset. Altmann and Kamide found that after 'The boy will eat...' eyes reached the cake 87 ms before the word, against 127 ms after it for 'move'. Variants show looks to sound-alike or shape-sharing objects, and eye movements towards described events even on a blank screen. Any cover task is not the measure; the time course of fixations is. Requires precise audio-gaze alignment and careful layout control.

Attributes

Loss type
Unmigrated
Effort
Weeks

Steps

  1. Design scenes containing a target, competitors (sound-alike, shape- or colour-sharing) and distractors, with positions counterbalanced.
  2. Record spoken stimuli and mark word onsets precisely.
  3. Give a cover task, such as following the instruction or judging whether the sentence fits the picture.
  4. Record eye movements with a tracker sampling at 250 Hz or more, synchronised with audio.
  5. Compute fixation proportions to each object in time bins (for example 20-50 ms) relative to word onsets.
  6. Compare time courses across conditions, for example ambiguous versus unambiguous wording, using growth-curve or cluster-based analyses.

Sources

  • Cognitive Psychology (Goldstein, 2019)
  • Louder Than Words (Bergen, 2012)
  • The Mind (Goldstein, 2020)
  • The Development of Language (Gleason & Ratner, 2024)

Also known as

  • VWP
  • Eye movements during spoken language comprehension
  • Visual world paradigm and eye movements during listening
  • Anticipatory eye movements
  • Looking at nothing

Categories

  • User Research
  • Cognitive Psychology & Perception