Why AI Progress Depends on the Kind of Assumptions We Stop Making
Hatched by Malcolm Mason Rodriguez
Jun 29, 2026
10 min read
2 views
28%
The Strange Problem at the Heart of Intelligence
What if the main obstacle to building intelligent machines was not thinking too little, but assuming too much? That sounds backwards until you notice how often progress comes from stripping away the habits that feel most human. In AI, the recurring drama has never been just about smarter algorithms or faster chips. It has been about which assumptions can survive contact with reality.
That same tension shows up in politics, business, and everyday judgment. We often believe we are making careful, rational choices, but in practice we rely on hidden frames, inherited scripts, and convenient shortcuts. Those shortcuts make the world usable. They also make us vulnerable to brittle thinking, where a system works beautifully until it meets an unusual case. The deepest lesson from AI history is not that machines will soon think like us. It is that intelligence, whether artificial or human, depends on the ability to hold assumptions lightly while still acting decisively.
A curious detail sharpens the point. A politician can attack a rival today while having donated to that same person yesterday. The move is not logically consistent, but it is socially legible. It follows a script. That small fact captures a larger truth: human behavior is often organized less by formal logic than by shifting frames of interpretation. AI has spent decades trying to recreate that flexibility, and in doing so it has revealed something uncomfortable about us. We are not machines of pure reason. We are pattern engines living inside assumptions.
The Dream of Clean Logic and the Mess of Reality
The earliest ambition in AI was elegant. If reasoning could be reduced to formal logic, then intelligence would become programmable. This vision was attractive because logic feels clean, stable, and transparent. It promises a world in which every conclusion follows from explicit rules, and every mistake can be traced to a faulty premise. In principle, that is a beautiful architecture for thought.
But reality resists being cleaned up so easily. Human life is full of concepts like chair, restaurant, trust, or insult, which are useful precisely because they are fuzzy. Nobody carries around a complete rulebook for what counts as a restaurant, or exactly when a casual remark becomes offensive. We navigate by context, expectation, and inference. That is why attempts to force ordinary intelligence into rigid symbolic systems kept running into trouble. The world is not broken into neat theorem-proving puzzles.
This creates the first great tension in intelligence work: precision versus usability. Pure logic is precise, but often unusable for everyday cognition. Common sense is usable, but hard to formalize. The result is a recurring false choice. Either build systems that are mathematically elegant but psychologically thin, or build systems that resemble human thinking but are too vague to scale. AI history is in large part the story of trying to escape that trap.
The problem is not that intelligence lacks structure. The problem is that its structure is mostly implicit.
That implicit structure is what makes frames, scripts, and contextual assumptions so important. They are not fully logical in the narrow sense, but they are deeply organized. When you hear “restaurant,” you do not just think of a building. You activate a set of expectations: menus, ordering, paying, being seated, waiting, eating, leaving. This is not a deduction from first principles. It is a compressed model of the world. Intelligence requires compression.
The same is true in organizations. A company can have perfect rules on paper and still fail in practice because nobody knows how to interpret the rules when the situation becomes ambiguous. The rulebook is not the intelligence. The ability to apply the rulebook under messy conditions is.
Why Progress Often Comes From Narrowing the Problem
AI’s history also teaches a second, less glamorous lesson: progress often comes not from solving intelligence in full, but from solving small pieces with extreme discipline. The most celebrated breakthroughs rarely happened because someone finally found the universal theory of mind. They happened because researchers chose a constrained problem, measured it carefully, and pushed hard enough to make it work.
That pattern matters because it explains why early AI repeatedly overpromised and underdelivered. It was tempting to imagine that a breakthrough in one domain, such as chess or expert systems, would generalize immediately to common sense, perception, or language. But intelligence is not a single ladder. It is more like a landscape with steep cliffs and hidden valleys. A system can climb quickly in one region and still fall apart one mile away.
This is where the horsepower analogy becomes useful. At low levels of computing power, certain forms of AI are simply impossible. Not because the ideas are wrong, but because the substrate is too weak. Yet once the threshold is crossed, what was impossible can become routine. That is a powerful reminder that capability is often phase shifted, not smoothly continuous. A system can appear stagnant for years and then suddenly become useful when hardware, data, and methods align.
But horsepower alone does not create intelligence. It only removes one barrier. A fast engine does not know where to go. Likewise, a faster computer can make a brittle approach scale, but it will not fix the wrong representation. That is why so many early systems became expensive maintenance burdens. They could work in a narrow setting, but when the world changed, they broke. In other words, they had speed without adaptability.
We see the same pattern in institutions and public life. A political message can be optimized for immediate impact, but if it lacks a stable frame of meaning, it collapses under contradiction. A campaign donor can be transformed overnight into an enemy because the underlying script has changed. Not the facts, but the interpretation of the facts, determines the new story. Systems fail not only when they are too weak, but when their assumptions are too rigid to absorb surprise.
Frames Are the Hidden Operating System of Thought
The most important AI insight may be that thought depends on frames, not just facts. A frame is a background structure that tells you what matters, what is typical, what can be ignored, and what surprises deserve attention. Without frames, every new experience would require rebuilding the world from scratch. With them, we can move quickly. They are the invisible scaffolding of judgment.
This is why people can seem irrational while still being highly competent. They are not deriving every conclusion from formal logic. They are using compressed models built from culture, memory, and social cues. Those models are often good enough, until they are not. Then the very thing that made them efficient becomes the source of error. A frame works like a map: indispensable for navigation, but dangerous if you mistake it for the territory.
AI systems have struggled with this because frames are easy to use and hard to encode. A human does not merely know that birds fly. A human knows that birds usually fly, unless the bird is injured, or the bird is a penguin, or the bird is in a cage, or the bird is a statue, or the question is metaphorical. What matters is not the fact itself, but the network of exceptions surrounding the fact. Real intelligence is an art of exception handling.
This is where the deeper connection to politics becomes surprisingly useful. Public figures often speak as if consistency were the highest value, but many real-world judgments are governed by frame shifts rather than by pure consistency. Yesterday’s ally can become today’s target because the social meaning of the relationship changed. That does not make the behavior wise, but it does make it legible. People operate within narrative frames, and narratives can be revised overnight.
We are not just reasoning beings. We are context-switching beings.
This is the central lesson AI keeps forcing into view. The challenge is not to eliminate frames. It is to become aware of them, test them, and update them before they harden into dogma.
The Real Measure of Intelligence Is Grace Under Surprise
If there is one criterion that separates brittle systems from genuinely intelligent ones, it is not just accuracy. It is grace under surprise. A system is intelligent to the degree that it can encounter the unexpected without collapsing into nonsense. That applies to software, institutions, and people alike.
Think of a customer service chatbot that answers 10,000 routine questions flawlessly but fails the moment a user asks something slightly unusual. It is not really smart. It is overfitted. The same is true of a manager who handles familiar employees well but becomes authoritarian when an unforeseen crisis hits. Or a political supporter who can explain every favorable fact but cannot process contradiction without attacking the messenger. These are all forms of brittleness.
The most useful mental model here is to distinguish between surface competence and structural adaptability. Surface competence is what you can do when conditions are predictable. Structural adaptability is what lets you remain effective when conditions shift. AI history suggests that many systems look impressive on the surface because they have absorbed a narrow set of assumptions. The hard part is designing minds that can revise themselves without losing coherence.
That is also why the progress of AI has been so nonlinear. Speed helps. Specialization helps. Symbolic clarity helps. But the deeper breakthrough comes when a system can update its frames without starting over. This is difficult because every frame is both a guide and a constraint. Too loose, and nothing is stable. Too tight, and nothing is learnable.
Humans face the same tradeoff. We need assumptions to function, but our assumptions must remain negotiable. In practice, that means treating confidence as provisional. It means asking not only, “What do I believe?” but also, “What frame is making this belief feel obvious?” That question is uncomfortable because it reveals how much of our certainty is inherited, not earned.
Key Takeaways
-
Look for the hidden frame before debating the fact. When a conversation feels stuck, ask what assumptions are structuring the disagreement. Often the real conflict is not about the conclusion, but about the background story.
-
Treat intelligence as adaptability, not just accuracy. A smart system is not one that performs well in ideal conditions. It is one that stays coherent when the unexpected happens.
-
Use rules for stability, but keep exceptions visible. Rules are valuable compression tools, but they become dangerous when you forget the cases they exclude.
-
Beware of brittle success. If something works only in narrowly controlled conditions, it may be optimized for the past rather than prepared for the future.
-
Audit your own scripts. Notice when you are reacting according to a familiar narrative, especially in politics, work, or relationships. Scripts save time, but they can also blind you.
The Lesson AI Is Teaching Us About Ourselves
The deepest promise of AI was never just automation. It was self-knowledge. By trying to build machines that reason, we are forced to confront what reasoning actually is. And the answer is less flattering, and more interesting, than we hoped. Thought is not pure deduction. It is a negotiation between rules and context, efficiency and exception, speed and depth.
That is why the history of AI keeps oscillating between neatness and scruffiness, between formal systems and messy heuristics, between logic and frames. Each camp captures something real. Logic gives us discipline. Frames give us relevance. Hardware gives us scale. None of them alone is enough. Intelligence emerges where they meet, but only if the system can tolerate ambiguity without becoming incoherent.
So perhaps the most important question is not, “When will machines think like us?” It is, “Can we learn to think with more awareness of our own frames before they turn into dogma?” That is a more urgent challenge than building a perfect mind. Because the same brittleness that breaks AI systems can break arguments, institutions, and entire civilizations.
The world does not reward the most rigid model. It rewards the model that can survive contact with reality and still keep learning. In that sense, intelligence is not the elimination of assumptions. It is the disciplined art of revising them.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣