Open Models, Open Threats: Why Cheap Intelligence Changes the Security Game
Hatched by Ante Gojsalić
Jul 15, 2026
10 min read
2 views
87%
The Strange Gift Hidden Inside Open AI
What happens when the cost of intelligence falls faster than the cost of defense?
That is the uncomfortable question at the center of the next era of security. For years, the story of AI was framed as a race for capability: bigger models, more parameters, more benchmarks, more breakthroughs. But there is a second story hiding underneath that one, and it matters more for most organizations and people. Once powerful language models become openly available, easy to adapt, and cheap to run, the barrier to doing sophisticated work collapses for everyone, including attackers.
This is the paradox. The same development that democratizes research, coding, and automation also democratizes deception, reconnaissance, and malware creation. A model that can draft a convincing email can also draft a convincing phishing campaign. A model that can help a developer patch code can also help an attacker generate variant after variant of malicious code until a signature based defense misses it.
The deeper issue is not simply that AI is powerful. It is that AI is becoming scalable cognition on demand. Once cognition becomes a commodity, the old assumptions that protected us, such as attack effort, manual labor, and limited specialization, begin to erode.
The Real Asymmetry Is Not Intelligence, It Is Distribution
When people think about cyber risk, they often picture a highly skilled hacker versus a strong security team. That mental model is already outdated. The more important asymmetry now is between how quickly offensive capability spreads and how slowly defensive institutions adapt.
Openly released foundation models matter because they lower the threshold for participation. A lone operator no longer needs to build a model from scratch, pay for frontier research, or assemble a large team. They can start with a capable base model, fine tune it, prompt it, or wrap it in automation. In practical terms, that means the attack surface of society grows not only because there are more machines, but because there are more people who can wield machine level leverage.
Think of it like this: if cybercrime used to require hand tools, AI gives the attacker power tools. If AI is open and efficient, then those tools become available at warehouse scale. The danger is not one genius adversary. It is thousands of opportunists, each now able to automate what once required patience, fluency, and time.
This changes the economics of crime. Spam became a nuisance when sending one message cost almost nothing. Phishing became industrial when messages could be personalized. AI pushes both dynamics further. It does not just increase volume. It increases plausibility, adaptability, and speed of iteration.
That trio matters more than raw sophistication. A mediocre scammer with an AI system that can write fluent messages, imitate tone, translate instantly, generate fake identities, and vary tactics by target is more dangerous than a brilliant scammer working alone. Defense has always struggled against scale. AI makes scale cheap.
The most important security shift is not that attackers become smarter. It is that intelligence becomes abundant enough to be operationalized at scale.
Why Synthetic Trust Is the New Attack Surface
The first wave of AI enabled attacks will likely be social, not technical. That is not because technical attacks are impossible, but because human trust is the softest and most profitable surface to automate.
Phishing used to be limited by language quality and personalization. A scam email from a foreign address could be spotted by broken grammar, odd phrasing, or generic content. That era is ending. With synthetic text, attackers can craft messages that sound like an IRS notice, a landlord, a coworker, or a procurement officer. With synthetic voice, they can impersonate a boss asking for an urgent transfer. With synthetic images or documents, they can create evidence that a request is real.
The result is not merely better fraud. It is a crisis of verification. Human beings are trained to trust familiar cues: a recognizable tone, a convincing signature, a plausible reason for urgency. AI can now manufacture those cues on demand.
The issue extends beyond email. Consider a real estate scam. In the past, a fraudulent wiring request might depend on the victim not noticing awkward wording or a suspicious email domain. Now an attacker can generate multiple versions, each tailored to the recipient’s role, region, and relationship history. The message can be adjusted in seconds until it feels local, normal, and timely. That is not just automation. It is customized persuasion at machine speed.
This is where many defenses fail conceptually. Traditional cybersecurity often assumes a stable boundary between legitimate and malicious input. But synthetic media blurs that boundary. If a voice message sounds exactly like your manager, and the text message uses the same phrases they use, and the document format matches your company template, what exactly is left for intuition to grab onto?
The answer is process. The future of trust will depend less on whether something appears authentic and more on whether it can be independently verified. In other words, the age of synthetic trust demands a shift from recognition to confirmation.
Open Models Are Not the Problem. Unprepared Systems Are.
It is tempting to blame openness itself. If powerful models are available to everyone, perhaps the solution is to slow release, centralize access, or pause deployment. But that instinct misunderstands the larger competition.
Once a capability exists, it rarely stays confined to the most cautious actors. If one group restricts itself, another does not. If one company pauses, another iterates. If one nation slows down, another accelerates. The practical result is not safety, but a transfer of advantage to actors willing to move first. In that context, open and efficient models are not a side issue. They are the battlefield.
At the same time, openness can strengthen defense. Public models let researchers test vulnerabilities, study misuse patterns, and build countermeasures more quickly. They also reduce dependence on a small number of proprietary systems whose internal behavior can be hard to inspect. The problem is not that models are open. The problem is that defensive institutions often remain closed, fragmented, and slower than the threats they face.
That creates a dangerous mismatch. Attackers can compose open tools into offensive workflows rapidly. Defenders, by contrast, must coordinate across legal, organizational, and technical constraints before they can deploy anything at scale. The attacker’s unit of action is the prompt. The defender’s unit of action is the policy meeting.
A useful analogy is epidemiology. A virus spreads through tiny, repeated interactions. Public health only succeeds when it can detect, trace, and interrupt those interactions faster than the disease multiplies. AI enabled threats behave similarly. Once a malicious technique is copied, adapted, and redistributed, the defender faces an outbreak, not an isolated event.
That is why the debate should not be framed as open versus closed. It should be framed as adaptive versus brittle. An open model ecosystem is dangerous when defenses are brittle and static. It becomes valuable when it supports rapid detection, auditability, and countermeasure development.
The New Security Principle: Verify Everything That Can Be Synthesized
The deepest consequence of cheap AI is not that bad actors gain a new tool. It is that many of the signals we used to rely on become forgeable.
If text can be generated, text alone is weak evidence. If voice can be cloned, a phone call is no longer proof. If images can be synthesized, screenshots are no longer decisive. If code can be autogenerated and mutated, signatures are less reliable. Each of these shifts pushes security away from surface cues and toward stronger forms of assurance.
This suggests a new principle: anything that can be cheaply synthesized should not be trusted as standalone proof.
That principle has practical implications. Organizations need layered verification for high consequence actions. A wire transfer should require out of band confirmation using a separately authenticated channel. Account recovery should not depend on a single voice call. Software pipelines should assume that code generated by an AI may be syntactically correct but strategically malicious, and therefore should pass through stricter review and behavioral testing.
The principle also changes how we think about defense strategy. Instead of asking, “Can we stop every attack?” the better question is, “How do we make attacks expensive again?” If AI gives attackers low cost repetition, then defenders should aim to reintroduce friction through identity proofing, anomaly detection, access segmentation, rate limits, and human escalation for high risk actions.
In other words, defense in the AI era is not about proving that a message is fake. It is about creating systems in which a fake message, even if plausible, cannot complete the transaction by itself.
Security is moving from content inspection to process integrity.
That shift matters because content will increasingly be synthetic. Process, however, can still be designed to resist impersonation.
What This Means for Builders, Leaders, and Everyone Else
The temptation in moments like this is either panic or abstraction. Panic says everything is unsafe. Abstraction says the problem is too big to act on. Both are mistakes.
The real response is to treat AI driven threat escalation as a design challenge. Systems should be built with the assumption that attackers can generate infinite variants, imitate human style, and automate at near zero marginal cost. That means organizations should harden the places where decisions are irreversible, expensive, or high trust.
For builders, this means designing workflows with verification baked in, not bolted on. For leaders, it means prioritizing security controls that do not depend on human recognition of authenticity. For individuals, it means becoming more skeptical of urgency and more disciplined about confirmation, especially when a request involves money, credentials, or privileged access.
The most resilient organizations will not be the ones that assume AI can be blocked at the perimeter. They will be the ones that assume AI is already inside the ecosystem, shaping both offense and defense. Their advantage will come from architecture, not optimism.
A final way to see the problem: the internet made information abundant. AI makes generated action abundant. That is why the risk is larger than phishing or malware alone. We are entering an era where the marginal cost of persuasion, coding, and deception can fall toward zero. Once that happens, the central question becomes not whether malicious content can be created, but whether our institutions can still tell the difference between appearance and authorization.
Key Takeaways
- Do not trust appearance alone. Any email, voice call, image, or document can now be synthesized convincingly enough to bypass intuition.
- Build verification into process, not judgment. For money movement, account recovery, and privileged actions, require independent confirmation through a separate channel.
- Assume attackers can iterate faster than defenders. Design controls that limit retries, flag anomalies, and force friction when stakes are high.
- Treat open models as infrastructure, not just tools. Their availability accelerates both legitimate innovation and malicious automation, so defenses must evolve just as quickly.
- Focus on process integrity. The most durable security in an AI saturated world will come from systems that remain safe even when content is synthetic.
The Real Lesson of Open Intelligence
The story here is not that AI creates perfect attackers. It is that it lowers the cost of enough capability, to enough people, that the security environment changes qualitatively. Cheap intelligence does not eliminate the need for expertise, but it does compress the advantage that expertise once provided to defenders.
That means the central security question is no longer, “How smart is the model?” It is, “What happens when intelligence becomes easy to rent, easy to copy, and easy to weaponize?” The answer is not apocalypse, and it is not complacency. It is a redesign of trust itself.
We are not just defending against machines that can think. We are defending against machines that can make fraud, impersonation, and malware as repeatable as copying a file. Once you see that, security stops being about spotting the fake. It becomes about building systems in which the fake cannot easily win.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣