Why Foxes Are Better Forecasters Than Hedgehogs | Philip Tetlock

TL;DR

This analysis explores the concept of good political judgment and the difference between foxes and hedgehogs in the context of forecasting accuracy.

Transcript

good evening welcome to another seminar about long term thinking sponsored by the long now foundation my name is Stuart brand Phil tetlock has anticipated something long now has wanted to do by about a hundred years we have a site called long baths org where people register predictions right out in public and people vote on them and they some peopl... Read More

Key Insights

• 👋 The concept of good political judgment can be objectively assessed through trans-ideological benchmarks.
• 🦊 Experts who exhibit a fox-like cognitive style tend to have better judgment accuracy.
• 🦊 Hedgehogs are more likely to make extreme predictions, while foxes embrace uncertainty and consider multiple perspectives.
• 🤗 Experts can improve their judgment accuracy by keeping score on their own predictions and being open to learning from their mistakes.

Questions & Answers

Q: How did the research on political experts' predictions contribute to the study of long-term thinking?

The research aimed to assess the judgmental accuracy of political experts over time and provide objective benchmarks for long-term thinking. By keeping score on one's own judgment accuracy, experts can learn from their mistakes and improve their forecasting abilities.

Q: What is the difference between foxes and hedgehogs in terms of judgment accuracy?

Foxes are more skeptical of big theories and are willing to consider multiple perspectives. They tend to have better calibration and discrimination scores. In contrast, hedgehogs are more likely to rely on one central vision and make extreme predictions.

Q: Can experts change their thinking style from hedgehogs to foxes or vice versa?

It is possible for individuals to shift their thinking style to some extent, but there is also a genetic component to being a fox or a hedgehog. Most people have the ability to think in both ways, but some may be more predisposed to one style.

Q: Is there a relationship between charisma and judgment accuracy in public experts?

In general, charismatic experts may be more attractive to mass audiences, but they may not necessarily have superior judgment accuracy. Experts with more cautious and qualified statements tend to have better forecasting performance, even if they are not as charismatic.

Summary & Key Takeaways

• The concept of good political judgment is often viewed as subjective, but it is possible to construct trans-ideological benchmarks that experts can agree on.

• Two categories of benchmarks are used to assess judgment accuracy: knowledge indicators and meta knowledge indicators.

• Experts who exhibit a fox-like cognitive style tend to outperform hedgehogs in terms of calibration and discrimination.