Biased assimilation of evidence

Description

People with opposing prior views rate the same mixed evidence; each side finds supportive studies convincing and opposing ones weak, measuring myside bias in evaluating evidence.

A questionnaire first classifies participants by their position on an issue. Everyone then reads descriptions of studies that support and oppose that position, matched in quality and method, and rates how convincing each is. In the original study on capital punishment, each side rated the studies that agreed with them as convincing and the others as flawed, and exposure to mixed evidence polarised rather than moderated views. The design is a clean way to measure selective acceptance of evidence: the same material is evaluated differently depending on prior commitment. Rigour depends on balanced, quality-matched study descriptions, counterbalanced order and an attitude measure taken before and after.

Attributes

Loss type
Unmigrated
Effort
Days

Steps

  1. Measure each participant's prior position on the issue with a short questionnaire, and select or stratify for clear supporters and opponents.
  2. Prepare paired evidence descriptions that support and oppose the position, matched for method, sample size and quality.
  3. Counterbalance which design (for example cross-sectional or longitudinal) is attached to which conclusion.
  4. Have participants rate each piece of evidence for convincingness and methodological quality.
  5. Re-measure attitude after reading to test for polarisation.
  6. Analyse ratings by prior position and evidence direction; the interaction is the bias.

Sources

  • Cognitive Psychology (Goldstein, 2019)

Also known as

  • Myside bias test
  • Lord-Ross-Lepper paradigm

Categories

  • Analytics & Behaviour
  • Behavioral Science & Economics