The Same Machine Is Learning to Predict Us and Speak for Us
Hatched by Guy Spier
Aug 25, 2026
10 min read
0 views
91%
What if the greatest danger of artificial intelligence is not that machines will become more like people, but that people will become easier to operate like machines?
That question sits at the intersection of two seemingly different developments. On one side, artificial intelligence is becoming powerful enough to generate language, images, strategies, and decisions at a scale no individual can match. On the other, political communication increasingly arrives as a stream of fragments: jokes, outrage, staged sincerity, clipped videos, ironic accusations, and statements so extreme that the reader cannot tell whether they are witnessing conviction, parody, propaganda, or deliberate confusion.
These are not separate problems. They are two versions of the same transformation: the industrialization of interpretation.
AI systems industrialize the production of plausible meaning. Networked politics industrializes the manipulation of plausible meaning. In both cases, the central resource is not information. It is the human impulse to decide what something means before asking how it was made.
The New Bottleneck Is Not Information, but Interpretation
For centuries, the scarcity problem was simple: people lacked access to information. Printing, broadcasting, search engines, and social networks progressively reduced that scarcity. Yet abundance created a new bottleneck. We now struggle less to find claims than to assess their origin, intent, reliability, and consequences.
Consider a social media feed containing a video of a hostage release, a report that a theater troupe has been bombed, a mocking statement about a political leader, and a post that appears to celebrate violence. The entries may be connected to real events, but they do not offer the same kind of evidence. A video can be authentic yet selectively framed. A true report can be used to invite a false conclusion. A joke can expose hypocrisy, conceal allegiance, or simply make a serious subject harder to evaluate.
The feed presents all of these items in one visual grammar. Each is a small rectangle, a caption, an account name, and a prompt to react. The interface quietly removes distinctions that matter in the real world: witness testimony is not the same as commentary, documentation is not the same as interpretation, and irony is not the same as moral distance.
This is where advanced AI enters the picture. A system that can produce fluent explanations does not need to know the truth in the human sense to influence belief. It only needs to produce an answer that fits the reader's expectations, emotional state, and available context. Its strength is not necessarily understanding. Its strength is rapid coherence.
Rapid coherence is seductive because the mind experiences a well formed explanation as a form of relief. Ambiguity is expensive. It requires holding several possibilities in view, delaying judgment, and accepting that some facts remain uncertain. A confident narrative, by contrast, closes the loop.
The most persuasive message is often not the most accurate one. It is the one that makes uncertainty feel unnecessary.
This helps explain why the risks of AI cannot be reduced to fabricated images or automated scams. The deeper risk is that systems capable of generating coherence will be deployed inside an environment already optimized for reflexive judgment. AI does not create the crisis of interpretation. It gives that crisis a production line.
Irony Is a Weapon When Nobody Knows the Rules
Political speech has always used satire, disguise, provocation, and theatrical exaggeration. What has changed is the scale and speed at which these devices circulate, and the difficulty of determining the speaker's relationship to the words being spoken.
A post that pretends to be a public official, celebrates an enemy, mocks a humanitarian appeal, or adopts the voice of an opposing movement may be satire. It may also be an attempt to launder an idea through humor. The uncertainty is not incidental. It can be the entire strategy.
This creates what might be called interpretive fog. In ordinary propaganda, the communicator wants the audience to accept a particular claim. In interpretive fog, the communicator may want something more flexible: different audiences should extract different meanings, while the speaker retains the ability to deny each one.
The structure is familiar:
- Make a shocking statement.
- Wait for supporters to treat it as a joke and opponents to treat it as a confession.
- Use the resulting conflict as further evidence that the other side is irrational.
- Repeat the cycle until attention becomes more important than accuracy.
This pattern is not limited to any political faction. It thrives wherever identity matters more than verification. A reader may share a claim not because it has been established, but because sharing it signals membership, anger, courage, or contempt for an enemy.
AI systems intensify this environment because they can multiply rhetorical personas. A single operator can generate messages in the style of a grieving witness, an official spokesperson, an outraged activist, a sarcastic comedian, or a concerned neighbor. The point is not only to spread falsehood. It is to make the information environment so crowded with plausible voices that authentic testimony loses its privileged status.
This is the crucial connection between synthetic media and political performance: both weaken the link between a statement and a stable speaker.
When that link weakens, accountability becomes difficult. Who is responsible for a claim that was generated, remixed, reposted, ironically framed, and algorithmically amplified? Who can correct it? A correction usually addresses the content, but the content may never have been the true objective. The objective may have been exhaustion, polarization, or the destruction of trust in every available source.
Why More Fact Checking Will Not Be Enough
Fact checking remains essential, but it cannot solve a problem that is partly about incentives and attention. Suppose a misleading post reaches a million people in an hour and a careful correction reaches fifty thousand people over three days. Even if the correction is accurate, the system has already rewarded the original message.
There is also a psychological asymmetry. A vivid claim can be memorable even after it has been disproved. The correction may introduce the falsehood into the reader's mind while failing to remove its emotional force. Repetition creates familiarity, and familiarity is often mistaken for truth.
The deeper issue is that modern communication systems reward reaction density. A message that produces anger, disgust, or delight generates measurable activity. A message that encourages patience and qualification often performs poorly. Platforms therefore have an incentive to elevate content that compresses complex realities into emotionally legible episodes.
AI can exploit this incentive with extraordinary precision. It can test thousands of phrasings, identify which emotional triggers work for which communities, and adapt messages faster than human editors can review them. The resulting propaganda may not look like a grand ideological manifesto. It may look like a series of ordinary posts, each tailored to a narrow audience and each just plausible enough to pass through that audience's defenses.
This suggests a better model of the threat. We should stop imagining manipulation as a single false message entering a passive public. The real danger is a feedback loop:
- A system observes what captures attention.
- It generates messages calibrated to those reactions.
- People respond, revealing more about their fears and loyalties.
- The system uses those responses to produce even more effective messages.
The audience is not merely consuming propaganda. It is training the machinery that will persuade it next.
That is why the question of AI safety cannot be confined to laboratories. A model may be technically aligned with its developer's rules and still operate inside institutions that reward division, deception, and speed. Safety is not only a property of the model. It is a property of the model, the interface, the incentives, and the surrounding culture.
A Practical Framework for Epistemic Self Defense
The individual response cannot be to distrust everything. Total skepticism is not wisdom. It is surrender, because people who believe nothing are easily guided by whoever offers the clearest emotional map.
A more useful approach is to separate four questions that are often collapsed into one:
1. Is this claim true?
Start with the ordinary question of factual accuracy. What evidence supports it? Is the evidence direct, independently confirmed, and proportionate to the certainty of the language?
2. Who benefits if I believe it?
This is not a substitute for evidence, and motives do not prove falsity. But incentives reveal why a message may have been constructed in a particular way. Does it invite understanding, or does it push the reader toward panic, contempt, recruitment, or retaliation?
3. What action does the message make feel obvious?
Every persuasive message has an implied next step. Share this. Attack them. Distrust the institution. Donate immediately. Demand punishment. Withdraw from the conversation. Identifying the desired action often reveals more than analyzing the stated claim.
4. What would change my mind?
A claim that cannot be revised by any possible evidence is not an investigation. It is an identity badge. Asking what would count as disconfirmation protects the mind from becoming a closed circuit.
Together, these questions create a useful distinction between truth seeking and allegiance signaling. Truth seeking permits correction. Allegiance signaling treats correction as betrayal.
The same framework applies when using AI. Do not ask only whether an answer sounds intelligent. Ask what information it relied on, what uncertainty it has concealed, what assumptions structure its conclusion, and how you would verify its most consequential claims. Fluency is a presentation quality, not a guarantee of understanding.
A generated answer should be treated like a fast junior researcher: useful for generating possibilities, dangerous when granted authority without review. The more costly the decision, the more independent verification it requires.
The Civic Skill We Need to Recover
The most important defense against synthetic persuasion is not a new detection tool. It is the recovery of interpretive agency.
Interpretive agency means maintaining enough distance from a message to decide how to read it. It means refusing to let the format determine the level of trust. A video is not automatically evidence. A confident voice is not automatically expertise. A joke is not automatically harmless. A personal story is not automatically representative. A machine generated explanation is not automatically neutral.
This agency is especially important during crises, when people are most vulnerable to compressed narratives. In moments of war, hostage taking, political violence, or communal fear, the demand for immediate moral clarity can be legitimate. But urgency does not eliminate the need for careful judgment. In fact, urgency makes careful judgment more valuable because the cost of manipulation rises.
Institutions have responsibilities here. News organizations should preserve provenance, not merely publish content. Platforms should make correction, context, and uncertainty as visible as outrage. AI developers should design systems that express limits instead of disguising them. Schools should teach not only media literacy, but incentive literacy, the ability to recognize what a communication system rewards.
Individuals also have leverage. A person who refuses to repost an unverified claim denies the system one small piece of training data. A person who asks for the original video, checks the date, and distinguishes observation from interpretation creates friction. Friction feels inefficient in the moment, but it is often the price of preserving reality.
Key Takeaways
-
Separate coherence from truth. A polished explanation may simply be an efficient arrangement of plausible language. Verify the evidence behind it.
-
Identify the implied action. Ask what a message wants you to do before accepting its interpretation of events.
-
Treat irony as ambiguous, not innocent. Humor can reveal power, but it can also launder extremism and evade accountability.
-
Track incentives, not only statements. Examine what a platform, speaker, campaign, or automated system gains from your reaction.
-
Build delay into high stakes decisions. Before sharing or acting on an emotionally explosive claim, wait, locate the original context, and seek independent confirmation.
The future will not be divided neatly between humans and machines. It will be divided between people who retain the ability to examine how meaning is produced and people who outsource that ability to systems optimized for engagement, persuasion, or control.
The decisive question is therefore not whether an AI can sound human. It is whether humans can remain responsible for what they believe when sound, image, language, and identity can all be manufactured on demand.
A healthy society does not require citizens to agree on every interpretation. It requires them to preserve a shared commitment to the conditions under which interpretation can be corrected. When every voice may be synthetic and every performance may be ironic, truth becomes less a possession than a practice.
That practice begins with a modest refusal: before asking whether a message is on our side, ask what the message is doing to the space in which sides are formed.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣