Belief-bias syllogism evaluation

Description

People judge whether conclusions follow logically from premises, with logical validity crossed with believability, to measure how far plausible conclusions override sound reasoning.

The task presents syllogisms in a 2 x 2 design: valid or invalid form, crossed with a believable or unbelievable conclusion. Participants say whether each conclusion follows. The textbook pattern is that valid syllogisms are accepted about 80 percent of the time with believable conclusions but only 56 percent with unbelievable ones, while invalid ones with believable conclusions are still accepted about 71 percent of the time. Time pressure strengthens the effect. The design separates form (validity) from content (truth), which is exactly the confusion that affects how people read explanations, arguments and justifications. Rigour comes from the full crossing, matched content, and a time-pressure manipulation that shows whether people are relying on intuitive plausibility.

Attributes

Loss type
Unmigrated
Effort
Days

Steps

  1. Write syllogisms in four cells: valid-believable, valid-unbelievable, invalid-believable and invalid-unbelievable, with at least four items per cell.
  2. Match items across cells for length and structure, varying only form and conclusion content.
  3. Instruct participants to accept a conclusion only if it follows necessarily, assuming the premises are true.
  4. Present items in random order; optionally add a time-limited condition (for example 10 seconds per item) to increase reliance on intuition.
  5. Compute acceptance rates per cell and the belief effect (believable minus unbelievable) and logic effect (valid minus invalid).
  6. Test the interaction and check whether restating an invalid argument with neutral content exposes its form.

Sources

  • Cognitive Psychology (Goldstein, 2019)

Also known as

  • Belief bias task
  • Syllogism validity judgement

Categories

  • Analytics & Behaviour
  • Behavioral Science & Economics