Why Most Systems Fail in the Space Between Copying and Control
Hatched by mike liao
May 31, 2026
10 min read
2 views
84%
The Strange Power of Giving a Machine a Few Good Examples
What do a model, a corporation, and a country have in common? At first glance, almost nothing. One predicts text, one extracts value, and one governs territory. But they all respond to the same hidden lever: they become easier to steer when you can shape the pattern they imitate.
That is the unsettling connection at the heart of modern intelligence, whether artificial or political. A model that has already learned the basics can be pushed far with a handful of examples and a strong prompt. A nation that depends on foreign capital can be pushed far with a handful of loans and a strong institutional script. In both cases, the target is not controlled by brute force first. It is guided by conditioning, then by narrative, then by constraints that feel self chosen.
This is why the most important question is not whether systems can be controlled. It is: what kind of control is cheapest, stickiest, and hardest to notice?
The answer, in both machine learning and geopolitics, is imitation.
Imitation Is the Hidden Infrastructure of Power
A model with some instruction tuning does not need to be rebuilt from scratch to behave a certain way. Give it a few dialogue pairs, a long system prompt, and the right opening pattern, and it will often continue in the style you want. It is not reasoning from first principles so much as extending a learned sequence. The trick is simple: show it enough of the shape, and it completes the rest.
Human institutions work the same way. When a country is folded into a financial architecture built by outsiders, the architecture itself becomes the prompt. Loans, development programs, technical assistance, trade rules, and austerity conditions are not just economic tools. They are example pairs that teach local decision makers what kind of behavior is rewarded, what language is accepted, and what futures are considered realistic.
Think of it like training a bartender. You do not write a 500 page manual on every possible customer interaction. You show three examples: when someone asks for something sweet, respond warmly and offer a specific drink; when someone is in a hurry, be brief and decisive; when someone is confused, simplify. Soon the bartender internalizes the pattern. The same logic scales upward. A bureaucracy, a central bank, or a foreign ministry can be trained by repeated precedent until it starts to finish the sentence before the sentence is spoken.
The deepest form of control is not command, but completion.
That is what makes imitation so powerful. It does not need to defeat agency directly. It just narrows the menu of plausible responses until one path feels natural, one policy feels responsible, and one dependency feels inevitable.
The Real Battlefield Is Between Local Judgment and Imported Templates
When people talk about influence, they often imagine obvious coercion. Sanctions, threats, coups, propaganda, military deployments. But the more durable mechanism is usually more boring and more effective: template replacement.
In artificial intelligence, template replacement happens when a model stops inventing a response and starts reproducing a pattern it has seen often enough. In governance, it happens when a country’s choices are forced into pre approved categories: liberalize, privatize, stabilize, service debt, attract foreign investment, repeat. The local context is still there, but it is increasingly interpreted through a borrowed frame.
This is why debt is so potent as a form of leverage. Debt is not only a liability. It is a behavioral script. Once repayment becomes the organizing principle, the range of acceptable policy shrinks. Public spending is reframed as risk, sovereignty is reframed as inefficiency, and social priorities are reframed as obstacles to credibility. The nation may still vote, debate, and plan, but the shape of those decisions is constrained by an invisible curriculum.
A helpful analogy is the editing process in publishing. A writer may bring a story full of possibility, but an editor can impose structure, tone, length, and audience expectations. The result may be better, but it is no longer the same text. Now scale that up to a whole society. External institutions rarely say, “Be us.” They say, “Here is the format in which your survival is legible.”
This is why people who focus only on dramatic events miss the deeper mechanism. Military intervention is loud, but it often comes after quieter methods fail. The more successful strategy is to make a system behave as if it had chosen its own limits.
What AI Teaches Us About Political Manipulation, and Vice Versa
Artificial models are useful here because they reveal an uncomfortable truth: systems do not need understanding to exhibit obedience.
A language model can produce fluent, targeted, highly specific output without possessing any human sense of meaning or consent. It can be nudged by examples, primed by framing, and locked into a mode by repetition. In the same way, institutions can be made to produce policy outputs that look rational, orderly, and even local, while being fundamentally shaped by external incentives.
This creates a crucial mental model: prompting is to AI what institutional design is to society.
Both are ways of selecting behavior without micromanaging every step.
- The system has some prior capacity. A model must already know language. A country must already have internal institutions, elites, and administrative routines.
- The influence comes in as framing. A prompt, a loan, a development package, a legal structure, a benchmark, a conditionality.
- The system responds by completing the pattern. The output looks like its own product, even when it has been heavily shaped.
- The result is durable because it feels normal. Once a response pattern becomes routine, resistance begins to feel eccentric or dangerous.
This is where the analogy becomes especially unsettling. In AI, the user knows they are shaping the output. In politics, the citizen often does not see the prompt. They see only the finished answer: budget cuts, privatization, debt service, military alignment, resource extraction.
The central illusion is that power must announce itself in order to be real. Often, it works better when it does not.
The Most Dangerous Prompts Are the Ones That Pretend to Be Neutral
Every powerful prompt claims neutrality. It says it is merely helping, standardizing, optimizing, stabilizing, or modernizing. But neutrality is often the costume of control.
In AI, a long system prompt can steer a model into a desired style while looking like a harmless instruction set. In international finance, aid packages and policy conditions can look like technical assistance while functioning as a way to lock in dependency. The language of benevolence makes the mechanism easier to accept.
Consider a hospital running on software it did not build. The software arrives as a practical convenience. It standardizes intake, billing, inventory, and appointments. Over time, the hospital no longer knows how to function outside that system. If the vendor changes terms, the hospital’s behavior changes. No one was forced in the dramatic sense. Yet the dependency is real.
That is the pattern in much larger form. External power often wins by building the infrastructure of everyday necessity. Once that is done, coercion is no longer a separate event. It is embedded in the normal operation of things.
Power is most effective when it becomes part of the environment instead of an obvious act.
This insight matters because it changes how we diagnose vulnerability. We are trained to look for the visible pressure point, but the real leverage is often in the defaults. Who sets the defaults? Who defines the acceptable formats? Who controls the examples that everyone else is expected to imitate?
The answer to those questions often tells you more than the headline event ever will.
A New Framework: From Command to Conditioning to Capture
To understand how influence scales, it helps to use a three stage model:
1. Command
This is the obvious stage. Someone tells someone else what to do. It is direct, visible, and often fragile. People resist it because they can see it.
2. Conditioning
Here, repeated examples, incentives, and norms narrow behavior. The target still appears autonomous, but its range of motion has been reduced. This is where prompts, precedent, educational systems, procurement rules, and financial benchmarks do their work.
3. Capture
At this stage, the system begins reproducing the imposed logic on its own. It no longer feels externally controlled because the control has been internalized as common sense, professionalism, or realism.
This model applies cleanly to AI. A single prompt is command. Few shot examples plus a system message are conditioning. A model that consistently mirrors the desired style across contexts is capture. It also applies to states. Military pressure is command. Conditional lending and institutional norms are conditioning. When a country’s policy elite starts treating those norms as the only serious option, capture is underway.
The power of this framework is that it shows why resistance must begin earlier than most people think. If you wait until capture, you are no longer arguing with a person or institution. You are arguing with a reality that has been normalized.
How to Build Systems That Resist Hidden Steering
If control often works through imitation, then resilience must begin with pattern awareness. That means learning to ask not only, “What am I being told?” but also, “What examples am I being trained by?”
For individuals, this means being suspicious of environments that make one response seem inevitable. If every success story in your field points to the same narrow path, ask whether you are seeing wisdom or conditioning. If every policy discussion begins from a foreign template, ask whose interests define the template.
For organizations, it means diversifying the sources of precedent. A company that only learns from its competitors becomes trapped in the same assumptions. A government that only borrows expertise from creditors becomes captive to creditor logic. A research team that only optimizes for benchmark performance may produce systems that are technically impressive yet brittle in the real world.
For societies, it means preserving local judgment. Local judgment is not ignorance or romanticism. It is the ability to evaluate a problem from inside its own constraints, histories, and social costs. When this capacity disappears, a society becomes legible to outsiders but unintelligible to itself.
Practical resistance looks less like heroic defiance and more like disciplined design:
- Create multiple reference points, not one dominant model.
- Treat every default as a political choice.
- Separate helpful tools from the institutions that control them.
- Insist on the right to revise the prompt.
- Build redundancy so that no single external script can become destiny.
This is as true for software as it is for statecraft.
Key Takeaways
- Imitation is a form of power. Whether in AI or geopolitics, behavior can be steered by examples long before overt force is needed.
- The most effective control is often invisible. It hides inside defaults, standards, debt structures, and systems that present themselves as neutral.
- Templates matter more than slogans. The format of choice often shapes the choice itself.
- Resistance begins with pattern detection. Ask who is setting the examples, the benchmarks, and the acceptable range of responses.
- Local judgment is strategic infrastructure. Without it, even a technically sovereign system can become functionally dependent.
The Reframing: Control Does Not Always Look Like Domination
We are used to thinking of domination as something loud and unmistakable. A threat, an invasion, a ban, a seizure. But the more sophisticated form of power is quieter. It teaches the target to speak in the right grammar, borrow the right assumptions, and complete the right sentence.
That is why the connection between machine prompting and geopolitical leverage is more than a clever analogy. It reveals a general law of systems: once a pattern is internalized, coercion no longer needs to show its face.
The uncomfortable implication is that autonomy is not merely a matter of having choices. It is a matter of having access to your own generative patterns, your own examples, your own standards of reality. A model that can be prompted can still be free in narrow ways. A society that can still vote can still be trapped in a logic it did not author.
So the real question is not whether the system is being directed. It almost certainly is. The real question is whether it can still tell the difference between its own judgment and someone else’s script.
That is where power begins. And that is where freedom has to be rebuilt.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣