The New Bottleneck Is Not Ideas, It Is Steering

mike liao

Hatched by mike liao

May 04, 2026

9 min read

71%

0

A Strange Parallel Between Nuclear Power and AI Agents

What do a nuclear buildout and an AI agent framework have in common? At first glance, almost nothing. One is about steel, uranium, regulatory approvals, and megawatts. The other is about language models, planning loops, and software architecture. But both are confronting the same modern truth: scale is easy to imagine and hard to control.

That is the real tension hiding beneath both stories. Governments can promise to triple nuclear capacity by 2050 because the climate math demands something bold. Builders of AI agents can sketch systems that reason, plan, and execute because the demo looks magical. Yet the moment ambition meets reality, the bottleneck is no longer vision. It is steering.

A society that wants abundant clean energy, and a software stack that wants useful autonomous agents, both face the same question: how do you build systems that are powerful enough to matter, but constrained enough to trust?

The future is rarely blocked by a lack of possibility. It is blocked by a lack of control over complexity.


Scale Is Not the Same as Capability

The nuclear renaissance makes a blunt point that applies far beyond energy. If global energy demand keeps rising, then wishful thinking about sufficiency will not hold. Solar and wind matter enormously, but grids also need firm, dispatchable power. Nuclear is entering the conversation because it solves a class of problems that intermittent sources cannot solve on their own.

But the phrase “triple nuclear capacity by 2050” hides a deeper challenge. A target is not a reactor. A pledge is not a supply chain. A headline is not an operating fleet. Nuclear power is a reminder that large systems require long, disciplined coordination across permits, financing, labor, fuel, engineering, and public legitimacy.

AI agents have their own version of this illusion. It is easy to watch a model write a plan, execute tasks, and revise itself in a loop and think the hard problem has been solved. But the first wave of agents, with their open-ended iteration, exposed the same issue at a different layer: the system can keep moving while quietly drifting off course.

That is what makes the comparison so useful. In both cases, the initial excitement comes from raw potential. The lasting value comes from institutionalized control.

A reactor is not just a power source. It is a tightly governed machine that converts risk into reliability through layers of engineering. A useful agent is not just a model that thinks. It is a workflow that converts uncertainty into action through layers of checks, constraints, and intervention points.

The lesson is simple but uncomfortable: more intelligence or more capacity does not automatically produce more usefulness. It often produces more opportunities to fail in interesting ways.


The First Wave Fails the Same Way Big Projects Fail

Open-ended agents are seductive because they resemble initiative. They can choose steps, pursue subgoals, and keep going without waiting for permission. That sounds like agency. In practice, it often resembles a junior employee with no supervisor, no checklist, and no stopping condition.

They go down the wrong branch. They overcommit to a bad assumption. They get stuck polishing one step because the loop has no natural interruption. Anyone who has worked on a large infrastructure project will recognize the pattern immediately. The project begins with a grand plan, then reality introduces branching dependencies, delays, and hidden constraints. Without control mechanisms, momentum becomes drift.

This is why the oldest industrial systems are often the most valuable. They do not merely generate output. They enforce procedural intelligence. A power plant, an airline, a surgical team, and a nuclear facility all encode the same principle: the system must be designed for the failures it will inevitably encounter, not the ideal case it hopes to enjoy.

That is the hidden connection between the nuclear buildout and the evolution of agents. Both fields are moving away from romance and toward operations.

The romance version says: build more reactors, build smarter agents, let the future unfold. The operational version asks: what happens when fuel deliveries slip, a supply chain bottlenecks, a model takes a bad turn, a task is misinterpreted, or a human needs to intervene at the exact right moment?

In both domains, the first order challenge is not creation. It is failure containment.


The High Agency Paradox: Freedom Needs Rails

The most important insight here is that high agency systems are not truly free. They are freedom inside rails.

That applies to nuclear energy, where the extraordinary power of the atom is only socially usable because it is boxed in by oversight, redundancy, regulation, and engineering discipline. It also applies to AI agents, where the most effective systems are not the most open-ended ones. They are the ones with the best scaffolding: clear objectives, bounded actions, observable states, checkpoints, and explicit opportunities for human correction.

This is a useful mental model:

Capability = intelligence multiplied by constraints that channel it.

Without constraints, intelligence can become erratic. Without intelligence, constraints become bureaucracy. The art is in combining them so that power becomes dependable.

Think about the difference between a self-directed intern and a well-run mission control room. The intern may have enthusiasm, but without process they will wander. Mission control has checklists, monitors, escalation paths, and clear authority. It looks less glamorous, but it actually gets rockets into orbit. The same design philosophy is what makes nuclear fleets work and what will make future agents genuinely useful.

This is why the first wave of agents underperformed. They tried to replace structure with initiative. The next wave will succeed by embedding initiative inside structure.

In other words, the future does not belong to systems that can think the longest. It belongs to systems that can stay on mission.

The best autonomous system is not the one that never needs help. It is the one that knows exactly when and how to ask for it.


China, Cop28, and the Politics of Constraints

The nuclear story also reveals something deeper about politics: serious plans emerge when old constraints become undeniable. The commitment to triple nuclear capacity is not just an energy policy announcement. It is an admission that the previous framing was too narrow. If energy demand rises substantially, then an energy strategy built mostly on ideological preference will break.

China’s aggressive nuclear expansion sharpens the point. It is not merely betting on a technology. It is betting on a system of coordination. Massive state capacity can mobilize financing, labor, and manufacturing toward an infrastructural goal over decades. Whether one admires that model or not, it demonstrates a crucial reality: scaling hard infrastructure is a governance problem before it is an engineering problem.

That same lens clarifies why agent frameworks are evolving away from purely open-ended loops. The best software teams are discovering that they do not need an agent that invents its own destiny. They need a system that can navigate a bounded environment, call tools, gather feedback, and stop when appropriate. This is governance at the code level.

So the deeper parallel is not simply that both fields are “about scale.” It is that both fields are discovering the necessity of protocols.

Protocols are what let power become legible. They make actions inspectable, reversible, and corrigible. They transform something potentially chaotic into something operational. Nuclear reactors need protocols to keep heat in check. Agents need protocols to keep language from becoming action without supervision.

The future belongs to protocol-rich systems.


A Better Framework: From Brilliance to Reliability

There is a temptation in both tech and policy to celebrate brilliance over reliability. We love a breakthrough, a moonshot, a dramatic demo, or a bold pledge. But societies do not run on brilliance. They run on dependable repetition.

Here is a more useful framework for thinking about any ambitious system:

  1. Generation: Can it produce enough raw output or capability?
  2. Direction: Can that output be channeled toward the right objective?
  3. Intervention: Can humans or governors step in before small errors compound?
  4. Recovery: Can the system fail without catastrophic damage?
  5. Repeatability: Can it do this reliably at scale?

Nuclear energy excels when generation is matched by direction, intervention, and recovery. A reactor is valuable not because it is powerful, but because power can be contained and repeated. Agent frameworks will mature for the same reason. The real milestone is not that a model can perform a task once. It is that it can perform it ten thousand times with bounded error.

This reframes what progress looks like. Progress is not a jump from zero to godlike autonomy. Progress is the gradual compression of uncertainty into manageable ranges.

That is why the most promising AI systems may feel less like autonomous geniuses and more like exceptionally disciplined operators. They will not roam freely across the internet because freedom is not the product. Reliable completion is the product.

Similarly, the future of nuclear will not be decided by slogans about abundance alone. It will be decided by whether the industry can master construction timelines, standardization, financing, and public trust. In both cases, the winning move is not to remove constraints. It is to design them well.


Key Takeaways

  • Scale creates new failure modes. Whether you are building reactors or agents, bigger systems need better control, not just more ambition.
  • Freedom inside rails beats open-ended autonomy. The most useful systems are constrained enough to remain predictable and interruptible.
  • Protocols are the hidden infrastructure of trust. Checklists, checkpoints, escalation paths, and supervision make power usable.
  • Reliability matters more than novelty. A system that works repeatedly under real conditions is far more valuable than one that impresses once.
  • The central question is not “Can it act?” but “Can it stay on mission?”

The Real Race Is to Build Systems That Deserve Trust

The excitement around nuclear power and AI agents comes from the same source: both promise to expand what humans can do. But their long-term significance depends on a less glamorous achievement. They must become systems that people, institutions, and societies can actually trust under pressure.

That is the deepest connection between these two apparently unrelated developments. Nuclear power reminds us that immense force only becomes civilization-building when it is disciplined by design. Agentic AI reminds us that apparent autonomy only becomes useful when it is disciplined by workflow.

So the next time someone talks about scale, ask a different question. Do not ask only how big it can get. Ask how it will be steered, corrected, and recovered when the world pushes back.

Because in the end, the future will not be won by the systems with the most raw power or the most apparent agency. It will be won by the systems that can convert ambition into reliable action without losing control.

That is the real bottleneck. And solving it may matter more than any single breakthrough.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣