Description
People choose between betting on their own judgement and a chance option of matched probability, revealing preference for sources of uncertainty they feel competent in.
Participants answer items and state calibrated confidence, then choose, item by item, between betting on their own answer and a lottery with the same probability of paying. Heath and Tversky found people preferred their own judgement in domains where they felt knowledgeable and the lottery where they did not, even at equal probability and even when their own bets paid less. Variants use complementary bets, lotteries set slightly above or below confidence, and pricing or certainty-equivalent versions that yield a per-person source-preference index. The effect is strongest when a clear and a vague option are seen side by side. The design is rigorous because probability is held constant, so remaining choice differences reflect preference for the source itself.
Attributes
- Discipline
- Behavioral Science & Economics
- Loss type
- Unmigrated
- Data
- Quantitative
- Effort
- Days
Steps
- Choose items from domains that differ in users' felt knowledge.
- Collect answers and calibrated confidence with an incentive-compatible scoring rule.
- For each item, offer a choice between betting on the own answer and a chance or system option with matched probability.
- Collect self-rated knowledge per domain and, optionally, certainty equivalents to compute a source-preference index.
- Analyse the share choosing their own judgement against confidence and knowledge, per person and overall.
- Check that any ambiguity manipulation has not shifted perceived probability, and compare joint with separate evaluation.
Sources
- Preference, Belief, and Similarity (Tversky, 2004)
- Heath, C., & Tversky, A. (1991). Preference and belief: Ambiguity and competence in choice under uncertainty. Journal of Risk and Uncertainty, 4
Also known as
- Judgement versus matched-chance choice test (competence, ambiguity and source preference)
- Competence hypothesis test
- Own judgement versus lottery choice
- Source preference test
Categories
- Analytics & Behaviour
- Behavioral Science & Economics