Why Intelligence and Collapse Are Built the Same Way

mike liao

Hatched by mike liao

May 23, 2026

9 min read

84%

0

The strange resemblance between a model and a famine

What if the same thing that makes a system smart also makes it fragile? That question sounds absurd until you look closely at two seemingly unrelated realities: a multimodal AI model learning to see, and a society under famine beginning to behave in ways that no planner intended.

In both cases, a system is not just processing inputs. It is discovering structure. A vision language model learns that pixels are not just pixels, but signs, edges, objects, scenes, and meanings. A starving population experiences something similar, but darker: once nutrition, sanitation, supply chains, and trust begin to fail, the system stops being a collection of isolated individuals and starts producing new, emergent phenomena, from disease to migration to violence.

That is the deeper connection: complex systems do not merely degrade when stressed, they reorganize. Sometimes that reorganization produces intelligence. Sometimes it produces catastrophe. The difference is not whether emergence happens, but whether the system has enough slack, feedback, and redundancy to keep emergence constructive instead of destructive.

The most important thing about a complex system is not what it contains, but what it starts to do when parts of it fail.


Intelligence is not the opposite of breakdown, it is structured emergence

When people hear “learn from scratch,” they often imagine building something from a blank slate, line by line, until capability appears. But the more interesting truth is that capability does not appear by adding rules one at a time. It appears when the system begins to compress the world into useful representations.

A multimodal model does this by turning raw data into layered abstractions. It learns that a photograph of a dog and the sentence “a dog is running” are not separate facts, but coordinated signals about the same underlying reality. In effect, the model develops a private map of the world that is smaller than the world itself, yet rich enough to predict and connect new things.

That same logic governs societies under stress. A normal society is full of latent connections: neighbors share food, institutions buffer shocks, roads move goods, clinics prevent disease, customs regulate behavior. When famine strikes, those connections do not vanish all at once. They reconfigure. Food scarcity changes crime. Crowd behavior changes migration. Sanitation failure changes disease. What once looked like separate problems becomes a single, cascading pattern.

This is why famine is rarely only about hunger. Hunger is the trigger, but the real disaster is systemic. The body becomes more vulnerable, yes, but the social organism also changes state. New behaviors emerge because the system has crossed a threshold.

The lesson is uncomfortable but useful: complex systems are threshold machines. Below a certain pressure, they absorb shocks. Above it, they cross into a new regime, and the new regime obeys different rules.


The hidden common language of models, cities, and epidemics

There is a tempting way to think about intelligence and collapse: one is good adaptation, the other is bad adaptation. But that framing is too simple. Both rely on the same mechanics.

A model is trained by exposure to many examples until it learns regularities. A city also learns, in a sense, by accumulating infrastructure, customs, transit patterns, and supply systems. An epidemic exploits those same regularities, but in reverse. It rides the routes that were built for commerce. A famine fever spreads where bodies are weakened and water systems fail. Mass migration follows the roads, ports, and borders where movement is possible. War becomes thinkable when the social grammar of cooperation starts to dissolve.

This suggests a provocative idea: every complex system has a shadow version of itself. The same network properties that enable resilience can also enable cascading failure. Dense connectivity helps information spread, but it also helps pathogens, panic, and panic buying spread. Efficiency lowers cost, but it also reduces buffers. Specialization increases productivity, but it also creates brittleness when one node fails.

Modern machine learning makes this visible in miniature. A model trained to be highly responsive can also become highly sensitive. A small perturbation can produce a big change in output. In society, the analog is a tightly optimized infrastructure with no spare capacity. It works beautifully until a shock arrives, and then the lack of slack becomes the shock.

This is why “resilience” is not the same as “strength.” Strength is brute resistance. Resilience is the ability to absorb disruption without changing identity. And identity, for a system, is really just the set of behaviors it can preserve under stress.


The real danger is not failure, but cascade

The most useful phrase in this whole conversation is not famine, model, or vision. It is cascade.

A cascade happens when one failure becomes a condition for the next. Food scarcity weakens immune systems. Weak immune systems increase disease. Disease reduces labor. Reduced labor damages logistics and sanitation. Damaged logistics create more scarcity. At that point, the system is no longer responding to the original cause. It is trapped in self-reinforcing feedback.

That is also how machine learning systems can fail in conceptual terms. A model does not “understand” in the human sense, but it can create internal feedback loops that amplify useful patterns or distort them. If the training distribution is rich, the model learns a layered representation. If the distribution is narrow or corrupted, it may overfit to brittle shortcuts. The system then becomes excellent at reproducing local regularities and terrible at generalizing under surprise.

The analogy matters because it highlights a universal law of complexity: the first failure is rarely the decisive one. The decisive event is the feedback loop that follows. That is why people often miss the true danger. They look for a single dramatic cause, when the real story is a sequence of small degradations that lock together.

Think of a city that depends on just in time food delivery. A storm knocks out transportation. Shelves empty. Panic buying begins. Prices rise. Informal distribution networks emerge. Crime rises around scarce goods. Healthcare personnel are stretched thin. The public loses confidence. Now the city is not merely facing a weather event. It is facing a systemic transition.

The same pattern appears in mental life too. Sleep deprivation lowers judgment. Poor judgment creates more stress. More stress worsens sleep. The cascade is what matters. Once started, it self-amplifies.

The unit of danger is not the isolated failure. It is the feedback loop that turns failure into a new normal.


Why building from scratch is a lesson in humility

There is a reason it is so valuable to build a vision language model from first principles. It forces you to confront how much apparent magic comes from layered simplicity. Nothing in the system is mystical. Embeddings, attention, projection layers, tokenization, loss functions, optimization, each piece is understandable on its own. Yet their interaction produces something that can connect image and language.

This is a powerful metaphor for society because collapse often feels mystical from the outside too. People ask how a country, a city, or a community could change so fast. But the answer is rarely that the world became unrecognizable overnight. The answer is usually that many small, comprehensible parts aligned in the wrong direction.

That is why “from scratch” thinking is not just a technical exercise. It is a discipline of humility. It reminds us that emergent behavior is not necessarily designed, and not all emergence is benign. A system can be elegant and dangerous at the same time.

Consider a simple analogy: a well organized kitchen. In calm times, every station is specialized. The pantry is stocked, the refrigerator is cold, the stove works, and ingredients flow smoothly. But remove electricity, delay deliveries, and cut water access, and the whole kitchen becomes a different machine. People start improvising. Perishable food spoils. Contamination risk rises. Tension rises. The same structure that made efficiency possible now accelerates disorder.

That is the lesson of threshold systems. Optimization assumes stability. Survival requires slack.


A practical framework: ask what emerges when the system is stressed

If intelligence and collapse share a common architecture, then the most useful question is not “Is this system strong?” It is “What does this system become under pressure?”

Here is a simple framework for thinking about any complex system, whether it is an AI model, a supply chain, a city, or even a personal routine:

  1. Inputs: What feeds the system? Data, food, energy, trust, money, attention.
  2. Transformations: How does the system convert inputs into outputs? Learning, production, coordination, communication.
  3. Buffers: What absorbs shocks? Inventory, memory, rest, redundancy, savings, social capital.
  4. Feedback loops: What gets amplified when things improve or deteriorate?
  5. Thresholds: At what point does the system stop adapting and start reorganizing into a new state?

This framework reveals why the same system can look stable right up until it suddenly is not. If buffers are thin, feedback loops are strong, and thresholds are close, then the system may appear efficient while quietly becoming fragile.

It also explains why the best systems often look a little inefficient. A model with room to generalize is not the same as one that merely memorizes. A city with redundant routes is not the same as one optimized for minimum cost. A household with an emergency fund is not the same as one that spends everything. Slack is not waste. Slack is the price of staying yourself when conditions change.


Key Takeaways

  • Stop asking only whether a system works in normal conditions. Ask what it does when one part fails.
  • Look for cascades, not isolated events. The real danger is often the feedback loop after the first disruption.
  • Treat slack as an asset. Redundancy, inventory, rest, savings, and spare capacity are forms of resilience.
  • Remember that optimization and fragility are neighbors. A highly efficient system can be dangerously brittle.
  • Use threshold thinking. Small changes can push a system into a completely different regime.

The deepest connection: intelligence and catastrophe are both forms of learning

Here is the most unsettling synthesis. A model learns by adjusting to patterns in data. A society under stress also learns, but not always in ways we would choose. It learns how to ration, migrate, distrust, hoard, flee, or fight. In both cases, the system is not static. It is being trained by its environment.

That means collapse is not merely an absence of order. It is a different order. Famine does not produce nothing. It produces new behaviors, new diseases, new hierarchies, new logics of survival. Likewise, a model does not produce random noise when it generalizes. It produces a new structure of association that was implicit in the data all along.

Once you see this, the old opposition between “smart” and “broken” stops being adequate. The more accurate distinction is between emergence that serves life and emergence that consumes it.

This is why the frontier of AI and the study of breakdown belong in the same mental room. Both teach that systems are defined less by their components than by their transitions. Both show that hidden structure becomes visible only under pressure. And both force us to ask a harder question than “How do we make this work?”

The harder question is: what kind of world are we building, one that becomes wiser under stress, or one that becomes more dangerous?

That question applies to code, to cities, to institutions, and to ourselves. If we wait until the cascade starts, we are already inside the new regime. The better move is to design for the moment before threshold, when a little slack can still prevent a lot of suffering.

In the end, intelligence may not be the opposite of collapse. Intelligence may be the ability to recognize patterns early enough to avoid becoming them.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣