Barnum (Forer) Acceptance Check

Description

Compare accuracy ratings of supposedly personal descriptions with generic or swapped ones, so that acceptance of personalised feedback counts as evidence only when it beats the control.

People readily accept as accurate a description presented as theirs even when it would fit almost anyone; Stangor shows a generic profile most readers accept and then its near opposite, which feels just as accurate. The same effect explains belief in horoscopes and some personality tests, and people cannot pick their own horoscope or tarot reading from others' at better than chance. The check turns this into a control: give some respondents the generic or opposite description, or ask each person to identify their own reading among several. Acceptance of personalised output is evidence of real fit only if personalised descriptions are rated more accurate than controls, or matching beats chance. The source presents demonstrations, so the protocol below is assembled from them.

Attributes

Loss type
Unmigrated
Stage
Evaluation
Effort
Days

Steps

  1. Prepare the personalised descriptions the product or study generates, framed as personal to each respondent.
  2. Create controls: one generic description given to everyone, or swapped descriptions belonging to other respondents, or the opposite description for half the sample.
  3. Randomly assign respondents to personalised or control descriptions and collect accuracy ratings on the same scale.
  4. For the matching variant, show each person several descriptions including their own and record whether they pick theirs.
  5. Compare mean accuracy between personalised and control conditions, or the matching hit rate against chance (1/k for k options).
  6. Treat high acceptance as evidence of fit only when personalised descriptions clearly beat the controls.

Sources

  • MIT Psychology (Stangor, 2012)

Also known as

  • Barnum effect test
  • Forer effect control
  • Generic-description control

Categories

  • Research Operations
  • Research Design & Rigor