First Principles: The Building Blocks of True Knowledge

First Principles: The Building Blocks of True Knowledge

In every systematic inquiry (methodos) where there are first principles, or causes, or elements, knowledge and science result from acquiring knowledge of these First-principles thinking is one of the best ways to reverse-engineer complicated problems and unleash creative possibility. Sometimes called “reasoning from first principles,” the idea is to break down complicated problems into basic elements and then reassemble them from the ground up. It allows them to cut through the fog of shoddy reasoning and inadequate analogies to see opportunities that others miss.

"I don’t know what’s the matter with people: they don’t learn by understanding; they learn by some other way—by rote or something. Their knowledge is so fragile!" — Richard Feynman

The difference between reasoning by first principles and reasoning by analogy is like the difference between being a chef and being a cook. If the cook lost the recipe, he’d be screwed. The chef, on the other hand, understands the flavor profiles and combinations at such a fundamental level that he doesn’t even use a recipe. He has real knowledge as opposed to know-how.

If we never learn to take something apart, test the assumptions, and reconstruct it, we end up trapped in what other people tell us — trapped in the way things have always been done. When it comes down to it, everything that is not a law of nature is just a shared belief. Money is a shared belief. So is a border. So are bitcoins.

After three “whys,” though, you often find yourself on the other end of some version of “we can take this offline.” "Science is a way of thinking much more than it is a body of knowledge." — Carl Sagan.

Moving onto the world of artificial intelligence, Sam Altman, OpenAI CEO, discusses the leap from GPT-3.5 to GPT-4 in an interview. Altman explains that the leap to GPT-4 involves numerous technical advancements in the base model. OpenAI focuses on finding multiple small wins and combining them for significant improvements. Altman emphasizes the importance of expanding the GPT paradigm to achieve true superintelligence and the discovery of new fundamental science.

He also touches upon the impact of AGI (Artificial General Intelligence) on society and the economy. Altman believes that AGI can make the world amazing, curing diseases, increasing material wealth, and improving people's overall well-being. Contrary to the belief that AGI will eliminate the need for human work, Altman argues that people want status, drama, new experiences, and the feeling of usefulness. The key lies in optimizing AGI development for a positive future and focusing on safety measures.

Altman also discusses the issue of consciousness in AI. While he does not believe that GPT-4 is conscious, he acknowledges the uncertainty surrounding the definition of consciousness in AI models. Altman mentions a conversation with his co-founder about training a model without any mention of consciousness and then introducing the concept. If the model immediately understands and responds to the subjective experience of consciousness, it would indicate some level of consciousness in AI.

Looking at the future of AI and its impact, Altman expresses concerns about disinformation problems and economic shocks that may arise beyond our preparedness. However, he believes in sticking to their mission and making a positive impact, even if other organizations may take shortcuts. Altman envisions multiple AGIs coexisting in the world, each contributing in their own way.

OpenAI's unique structure, with a nonprofit in charge and a subsidiary for profit, allows for non-standard decision-making and a focus on long-term goals. Altman admits the need for a balance between capitalism and nonprofit values to achieve their objectives effectively.

The interview also delves into the challenges of developing AI models that are neutral and controllable by users. Altman emphasizes the importance of giving users more control over the system's messages to ensure steerability and prevent biases. He expresses concern about biases in human feedback raters and their impact on AI models.

When discussing the future economy and the transformation it will undergo, Altman predicts that the cost of intelligence and energy will drastically decrease over the next few decades. These changes will drive economic and political transformations, with the economic shift having a more significant impact on the political landscape.

Altman touches on the failure of communism in the Soviet Union and emphasizes the importance of individualism, human will, and the ability to self-determine. He believes that centralized planning will always be inferior to distributed processes and betting on human ingenuity.

In terms of hiring and building great teams, Altman emphasizes the importance of time and investment in the hiring process. He personally approves every hire at OpenAI and believes in giving trust, autonomy, and authority to individuals while maintaining high standards.

Altman also highlights the need for leaders and experts to adapt to the rapidly changing world. He references the speed of the SVB bank run and how it caught many people off guard due to the advancements in technology. This serves as a preview of the shifts that AGI will bring, emphasizing the need for preparedness and understanding.

In conclusion, to apply first principles thinking, break down problems into basic elements, challenge shared beliefs, and reconstruct ideas from the ground up. When it comes to AI, focus on technical improvements and expanding paradigms to achieve true superintelligence. Consider the impact of AGI on society and optimize its development for a positive future. Strive for neutrality and user control in AI systems, and be aware of biases in human feedback. Prepare for economic and political transformations driven by the decreasing costs of intelligence and energy. Embrace individualism, self-determination, and distributed processes. Invest time and effort in hiring and building great teams. And finally, adapt and understand the rapidly changing world to navigate the shifts that AGI will bring.