When Power Becomes Infrastructure: What AI Design Teaches Us About Empire
Hatched by Faisal Humayun
May 23, 2026
10 min read
0 views
61%
The Hidden Question Beneath Both Debates
What kind of power lasts longer: the power that controls what you see, or the power that changes how you think?
That question sits underneath two seemingly unrelated conversations. One is about building intelligent systems, where the practical choice is often between retrieval augmented generation and finetuning. The other is about politics and geopolitics, where the argument is that domination is rarely sustained by ideals alone, but by force, incentives, and control of the environment.
At first glance, these belong to different worlds. One is machine learning architecture. The other is a critique of Western influence and economic order. But both are really about the same thing: how power gets embedded. Sometimes power is loud, visible, and coercive. Sometimes it becomes quiet, infrastructural, and so normalized that people stop noticing it. The deeper issue is not simply who wins, but what kind of system makes winning feel inevitable.
That is why the choice between RAG and finetuning is more than a technical decision. It is a miniature model of a political truth: do you govern through constant access to external facts and oversight, or do you reshape the system so thoroughly that it responds from within?
The most durable power is not the power that speaks the loudest. It is the power that becomes the default path.
RAG and Finetuning as Two Theories of Control
In AI, RAG and finetuning solve different problems. RAG gives a model access to outside information at the moment of need. Finetuning changes the model itself, making its behavior more specialized, more consistent, and often faster in a narrow domain.
That distinction looks technical, but it maps cleanly onto two broad strategies of governance and influence.
RAG is like a system of ongoing consultation. It preserves contact with an external world of evidence, documents, and changing facts. A doctor using a clinical assistant that cites current guidelines is safer when the system can look things up rather than rely on memorized assumptions. A legal tool is more trustworthy when it can retrieve the relevant statute rather than improvising from pattern alone. In social terms, RAG resembles a world in which authority is forced to answer to records, institutions, and public verification.
Finetuning is like internalizing a worldview. The model no longer needs to consult a library for every move because the pattern has been embedded in its parameters. This is efficient. It is also risky if the training data is narrow, biased, or outdated. In human terms, finetuning resembles schooling, propaganda, discipline, or institutional culture. It makes behavior smoother, faster, and more predictable, but it also makes the system less visibly dependent on outside correction.
This is where the analogy becomes illuminating. Power is often praised when it is efficient, and criticized when it is intrusive. Yet efficiency can be a mask for deeper dependence. A system that no longer has to ask questions can become very good at reproducing assumptions it never examined.
Consider a newsroom assistant trained only on a particular house style. It may sound polished and consistent, but it could also become blind to sources outside its frame. Now consider a newsroom assistant that retrieves from a broad archive each time. It may be slower and messier, but it can be audited. The choice is not just about performance. It is about whether truth is treated as something you consult or something you absorb.
That difference matters far beyond software.
When Infrastructure Becomes Ideology
A striking claim in political critique is that dominance is not primarily sustained by noble rhetoric. It is sustained by material structure: military force, economic leverage, debt, and control over the terms of survival. In other words, power does not need everyone to believe the same story if it can shape the conditions under which stories are told.
That is the infrastructure lesson hidden inside the RAG versus finetuning debate.
RAG is visible dependence. It reminds the system that knowledge exists elsewhere, that claims must be checked, that answers are provisional. Finetuning is invisible dependence. It embeds the rules so deeply that the system behaves as though they were natural. One keeps the outside world close. The other makes the outside world feel unnecessary.
This is not a moral verdict against finetuning. It is a warning about what happens when any system, technical or political, confuses internal consistency with legitimacy.
Empires, institutions, and platforms all face the same temptation: if you can make the environment conform to your model, you no longer have to justify the model itself. A social network that tunes its ranking system to maximize engagement does not need users to endorse its philosophy. It only needs them to keep scrolling. A powerful state that controls trade, debt, and security does not need admiration. It needs compliance.
The real danger is that these systems begin to feel natural. People adapt to the architecture and then mistake adaptation for consent.
Here is a useful way to think about it:
RAG asks, “What is true right now?”
Finetuning asks, “What should this system be like by default?”
Politics often hides the second question inside the first. It says, look at the results, look at the stability, look at the order. But stability is not the same as justice, and order is not the same as truth. A system can be very stable while resting on coercion that has simply become ordinary.
That is why the critique of empire and the design choice in AI rhyme so closely. Both force us to ask whether we want systems that remain answerable to the world, or systems that become so optimized for their own logic that the world must bend to them.
The Real Tradeoff: Accuracy, Agency, and Moral Distance
The common framing of RAG versus finetuning focuses on performance: latency, cost, consistency, maintenance. Those are real concerns. But beneath them lies a more important triad: accuracy, agency, and moral distance.
Accuracy means the system can reflect current reality rather than a frozen memory of it. RAG tends to win here because it can fetch fresh facts. In social systems, accuracy is what happens when institutions remain answerable to evidence, witnesses, and consequences. When power controls information too tightly, accuracy collapses into narrative management.
Agency means the system can act decisively without constant lookup. Finetuning tends to win here because it encodes behavior directly. In human institutions, agency is what allows organizations to move quickly, coordinate, and scale. But agency without correction becomes inertia. A highly efficient system can carry its own mistakes at high speed.
Moral distance is the most overlooked factor. It is the distance between the person or institution making decisions and the effects of those decisions on others. Externalized violence, outsourced suffering, and abstracted harm all increase moral distance. When consequences are hidden, systems can become ruthless while still imagining themselves neutral.
This is why some power structures survive scrutiny: they do not ask to be loved, only to be used. The economic system that profits from instability does not need to defend instability as a virtue. It merely needs to normalize the idea that profitability is a sufficient standard.
AI design gives us a small but revealing mirror. A model that retrieves evidence can be audited, corrected, and made to show its work. A model that has been heavily finetuned may feel more fluent and more elegant, but it can also hide the lineage of its judgments. The same is true of institutions. The more a system internalizes its premises, the more fluent it becomes at defending itself, and the less visible its assumptions become.
That is where the moral risk lies: fluency can disguise violence.
Imagine two border policies in miniature. One is a clerk who checks rules from a live database and can explain each decision. The other is a machine that has been trained to classify people using patterns that no one can easily inspect. Which one is faster? Probably the second. Which one is more accountable? Almost certainly the first. The technical tradeoff is obvious. The ethical tradeoff is usually hidden until it is too late.
A system that cannot explain itself may still be powerful. That does not make it trustworthy.
A Better Mental Model: Choose the Layer Where You Want Truth to Live
The deepest lesson is not that RAG is good and finetuning is bad, or that power is always corrupt. It is that every serious system has to decide where truth should live.
Should truth live outside the system, in documents, laws, databases, communities, and feedback loops that can challenge the machine? Or should truth live inside the system, in encoded habits, automated judgments, and fixed patterns of response?
This is the real design problem in AI and in politics alike. If truth lives only inside, the system may become elegant but brittle. If truth lives only outside, the system may become accurate but slow and fragmented. Most durable systems need both. The question is not whether to have internal memory or external retrieval. The question is which one is allowed to dominate.
Here is a practical framework worth using whenever you face this tradeoff:
-
Use retrieval when reality changes quickly. If the facts shift, the world should stay consultable. Medicine, law, policy, markets, and geopolitics all require live correction.
-
Use finetuning when behavior must be consistent and narrow. If the task is stable, repetitive, and bounded, internalizing the pattern can improve speed and reliability.
-
Prefer retrieval when accountability matters more than elegance. If you need to audit a decision, you want visible sources, not just fluent output.
-
Prefer finetuning when latency and user experience are central, but only with strong oversight. Speed is valuable. Speed without transparency is how errors scale.
-
Treat every optimized system as politically loaded. The more invisible the control mechanism, the more carefully it should be examined.
A company building a customer support assistant might finetune tone and workflow while using retrieval for product policies and account details. That is not just a technical compromise. It is a governance choice: keep judgment where the world can update it, and keep style where consistency helps the user.
The same principle applies to institutions. A healthy society does not try to store all truth inside a single center of power. It builds retrieval: courts, journalism, archives, dissent, public records, scientific revision. Those are not bureaucratic extras. They are the equivalent of making a system answer with sources instead of vibes.
Conversely, when a society overfinetunes itself around one ideology, one security logic, one profit metric, or one geopolitical story, it may become efficient at reproducing itself and blind to its own damage.
Key Takeaways
-
Ask where truth is located. If a system depends on external reality, build retrieval and auditability. If it depends on stable behavior, finetuning may help, but only with guardrails.
-
Do not confuse fluency with legitimacy. A smooth answer, a polished institution, or a confident empire can still be wrong, coercive, or opaque.
-
Separate efficiency from morality. A faster system is not automatically a better one. Speed often increases the scale of hidden harm.
-
Use hybrid design whenever possible. Keep the parts that change often outside the core, and encode only the durable patterns inside.
-
Treat infrastructure as ideology made visible. The structure of a system reveals what it assumes about who gets to know, decide, and correct.
The Final Reframe
We usually talk about power as if it were something you either have or do not have. But the more important question is how power is distributed across a system’s layers. Does it stay answerable to reality, or does it become so embedded that it no longer needs permission from the world it affects?
That is what connects AI architecture to empire. Both are struggles over whether the center must keep listening, or whether it can simply become the world. RAG is a commitment to consultation. Finetuning is a commitment to internalization. Each has a legitimate role. But when internalization goes too far, systems start mistaking their own momentum for truth.
The most dangerous power is not the power that lies openly. It is the power that no longer needs to ask, because it has made asking unnecessary.
And that is the question worth carrying forward, whether you are designing software, evaluating institutions, or trying to understand the world around you: what would it look like to build systems that remain corrigible, even when they become strong?
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣