The Power of Knowledge and the Defense Against Existential Danger

The Power of Knowledge and the Defense Against Existential Danger

In a world filled with optimists, pessimists, wise technology users, and enemies of civilization, one thing remains clear: knowledge is impartial. It can be used for good or evil. However, the enemies of civilization all have one thing in common – they are wrong. They fear error correction and truth, which makes them less creative and slower to innovate. In order to defend against the existential danger posed by malevolent uses of technology, the good guys must rely on their only advantage – speed.

But what exactly is this speed that can protect us? According to David Deutsch, a renowned physicist and mathematician, speed refers to the ability to adapt and change our ideas quickly. The enemies of civilization resist changes in their ideas, which hinders their creativity and innovation. Therefore, it is crucial for those who seek progress and a better future to embrace the power of knowledge and be open to new ideas.

Greg Egan, another influential figure in the world of science and mathematics, sheds light on the misconception that advanced concepts are complex and inaccessible to the wider population. In reality, many of these concepts involve simple manipulation of ideas that may be unfamiliar to most people. Egan compares the rules for doing tensor calculus, a concept considered advanced by many, to the rules of complex card games. He emphasizes that it is possible to demystify scientific ideas and make them more accessible to a broader audience.

One of the intriguing topics discussed by Egan is the concept of super-intelligent AI. While some argue in favor of quickly handing over the planet to a benign, super-intelligent AI to avoid being enslaved by a non-benign AI, Egan questions the feasibility and likelihood of such a scenario. He highlights the need to create a seed AI that can continually rewrite itself, ultimately leading to an AI that is so intelligent it becomes omnipotent. While this idea has made for fascinating science fiction stories, Egan suggests that those who believe it is an overwhelmingly likely outcome in the real world are simply waving their hands at close to the speed of light.

Another point of contention in the scientific community is the question of whether the human brain can be reduced to a chain of algorithms. Egan disagrees with scientists who argue that the human brain is fundamentally different from computers. He believes that once computers possess the same built-in tools, flexibility, and breadth of education as human beings, they will be as conscious as any human. Egan's perspective challenges the notion that consciousness is exclusive to biological beings and opens up possibilities for different forms of consciousness.

Individuality is a recurring theme in Egan's work, and he emphasizes the importance of critically assessing the ideas of others while contributing something original to one's own beliefs. He cautions against isolating oneself from other people's points of view, as it limits the potential for growth and understanding. Egan acknowledges the dangers of extreme abstraction but also recognizes its value in understanding the physical world. He believes that technology will continue to blur the line between raw sensory information and new forms of data extracted from reality.

In the realm of science, there are always fundamental principles that cannot be explained any further at a given moment in history. However, this is not a flaw in the scientific method. It is simply a reflection of our current level of knowledge. Science relies on systematic honesty and the willingness to accept the way things are, rather than clinging to preconceived notions or using the concept of "God" as an explanation for the unknown.

To conclude, there are three actionable pieces of advice that can be derived from the insights of Deutsch and Egan:

1. Embrace the power of knowledge and be open to new ideas. The enemies of civilization resist change, but progress requires adaptability and innovation.

2. Demystify complex scientific concepts and make them more accessible. By breaking down ideas into simpler manipulations, we can invite a wider audience into the loop of understanding.

3. Critically assess the ideas of others while contributing something original to your own beliefs. Individuality does not mean isolating oneself, but rather engaging with different perspectives and striving for personal growth.

In a world where knowledge is impartial, and enemies of civilization exist, it is up to us to defend against existential dangers through speed, adaptability, and a commitment to the pursuit of truth.