Why AI Security Is Becoming a Token Problem, Not a Talent Problem
Hatched by Kunal Grover
May 31, 2026
10 min read
3 views
89%
The strange new ceiling on cyber power
What happens when the biggest limit on offensive cyber capability is no longer human skill, but how many tokens you can spend?
That question sounds abstract until you combine two developments that should make every security team pause. On one side, a major bug bounty program is effectively on hiatus, no longer accepting new submissions. On the other, the latest AI systems are being described as major gains in cyber capability, with performance rising so fast that the upper bound is hard to pin down, and the bottleneck appears to be tokens used rather than raw ability.
Put those together and a new picture emerges: the security landscape is not just getting more automated. It is becoming capitalized. The scarce resource is shifting from human expertise to machine inference budget, from finding a clever exploit to funding enough attempts to discover one.
That is a profound change. It means the center of gravity in security is moving away from who is smartest and toward who can sustain the most continuous search.
From rare talent to industrialized attempt volume
For years, vulnerability discovery was constrained by human scarcity. Good attackers were rare. Great attackers were rarer. Bug bounty programs thrived because they could tap a distributed community of skilled individuals, each bringing creativity, patience, and a distinct set of instincts. The basic bargain was simple: pay for insight that could not easily be mass produced.
AI changes that bargain in a way many people still underestimate. A capable model does not merely assist an expert. It can act like a multiplier on trial volume. It can enumerate attack surfaces, generate payload variants, inspect logs, compare code paths, and propose alternate hypotheses at a scale no lone human can sustain. If its limit is not intelligence but tokens, then the relevant question becomes: how much searching can you afford?
That is why this feels different from earlier automation waves. Traditional scanners were narrow. They could detect known patterns, but they were brittle and repetitive. Modern models are broader. They can improvise, reframe, and keep going. In practice, that means the attack process starts to resemble a factory line. Not a factory for certainty, because security never offers that. A factory for attempts.
And attempts matter because vulnerability discovery is often a numbers game hidden inside a creativity story. The breakthrough may arrive as a flash of insight, but only after hundreds or thousands of dead ends. AI is exceptionally good at dead ends, because dead ends are cheap when tokens are cheap.
The old security economy rewarded insight. The new one increasingly rewards sustained search.
That shift does not make humans irrelevant. It makes human judgment more important at the points where machines generate too much output to review casually. The expert is no longer just a finder of bugs. The expert becomes a filter, a strategist, and an allocator of machine effort.
The broken promise of scarcity
Bug bounty programs were built on a beautiful assumption: that defenders could widen the talent pool just enough to stay ahead. Instead of relying on a few expensive specialists, organizations could invite many independent eyes, each searching for flaws in public view. The model worked because security weaknesses are distributed, and so is curiosity.
But there was always a hidden constraint. Bounty programs are still bounded by human time, human creativity, and human endurance. They rely on the premise that the number of people capable of discovering serious flaws is limited. AI weakens that premise.
If one skilled operator can direct a fleet of model driven probes, then the economics change. The same person can cover more surface area, try more permutations, and explore more failure modes than before. A break in submissions at a bounty program may seem like a narrow operational detail, but symbolically it fits a larger pattern: the traditional pipeline for crowdsourced security is under pressure from both sides. Attack capability is rising, while defensive systems struggle to absorb the resulting volume.
The challenge is not only that attacks may become more frequent. It is that the shape of discovery changes. A human tends to search with curiosity and focus. A model can search with relentlessness. That difference matters because many vulnerabilities are not found by elegant reasoning alone, but by exhaustive variation. What if the parser fails on a malformed edge case? What if the auth check is bypassed through one of ten thousand parameter combinations? What if the prompt injection only appears when the system is coerced through a bizarre chain of context shifts?
A human might never test all of that. An AI can, especially when the tokens are cheap enough.
This creates a disturbing asymmetry. Defenders usually have to be right everywhere. Attackers only have to be right once.
The token economy is the new battlefield
The phrase “limited by tokens rather than ability” is more than a technical observation. It is a strategic diagnosis.
Tokens are not just a billing unit. They are the fuel of exploration, the budget for reasoning chains, code generation, tool use, and iterative refinement. When a cyber capable model hits a ceiling, that ceiling may be economic rather than intellectual. In other words, the model may be able to keep going, but the operator may not be able to pay for the continuation.
This creates a new competitive layer in security: who can afford to search longer.
Imagine two teams trying to break into the same system. Team A has a brilliant human researcher with deep intuition, but a limited number of attempts. Team B has a competent operator with a model running thousands of probes, each slightly different from the last. Team A may still win on a rare and elegant flaw. But Team B now has access to something historically unavailable: industrial scale curiosity.
That does not mean every attack becomes trivial. It means the distribution of risk changes. Systems that were once protected by obscurity, complexity, or a lack of patient attackers become less secure. The easy victories get automated, and the hard ones become more reachable simply because there is more machine time to spend on them.
Consider a real world analogy. A master locksmith can sometimes open a difficult lock with skill and intuition. But if you give a machine thousands of picks, shims, and minute adjustments, you have transformed the problem from craftsmanship into throughput. The lock does not get weaker. The attacker just gets more attempts per dollar.
That is the core transformation in AI driven security: capability is no longer the whole story. Marginal search cost is.
What defenders should learn from the bug bounty slowdown
If attack capability is scaling faster than human review capacity, then defenders need to stop thinking in purely reactive terms. The old fantasy was that more eyes would naturally restore balance. The new reality is that more eyes may simply mean more incoming signals than anyone can process.
This is where the brokenness of the bounty model becomes instructive. A pause in submissions is not just a pause in work. It is a reminder that security systems can saturate. Intake channels clog. Triage backlogs grow. Review teams become overwhelmed. The very mechanism designed to surface hidden issues can become a bottleneck if the volume of findings, whether genuine or AI generated, exceeds the organization’s capacity to evaluate them.
That suggests a different security posture. Instead of asking, “How do we find more bugs?” the better question may be, “How do we become harder to search?”
This leads to three practical shifts:
-
Reduce exploitable surface area. Fewer endpoints, fewer permissions, fewer weird states, fewer legacy pathways. Every removed branch is one less place for a model to spray attempts.
-
Design for anomaly resistance, not just known attack patterns. Static signatures age quickly when the attacker can remix tactics endlessly. Systems need stronger runtime controls, tighter invariants, and more robust fail safe behavior.
-
Treat review capacity as a strategic asset. If attack generation scales through tokens, then defensive triage, validation, and incident response must be redesigned for speed and prioritization. Otherwise defenders drown in their own intake.
The lesson is uncomfortable but clear: security is moving from a world of scarce attackers to a world of abundant probes. The organization that survives will not be the one that can read every alert. It will be the one that makes alerts less necessary by constraining what can happen in the first place.
When the cost of exploration falls, the cost of ambiguity rises.
A new mental model: security as search friction
Here is the framework that connects these developments most usefully: think of cyber defense as a contest over search friction.
Search friction is everything that slows an attacker’s ability to turn ideas into effective attempts. It includes network segmentation, authentication barriers, rate limits, secrets management, sandboxing, observability, and architectural simplicity. It also includes the difficulty of obtaining clean feedback from the system, because models improve when they can rapidly test hypotheses.
In the human era, search friction mostly mattered against patience and skill. In the AI era, it matters against scale. That is a very different adversary.
A few examples make this concrete:
- A poorly segmented internal network used to be risky because a human operator might eventually pivot through it. With AI, a model can enumerate routes, configs, and service interactions much faster.
- A web app with many edge cases used to be hard to audit because humans got bored. With AI, boredom disappears. The model can keep generating variants until one lands.
- A prompt sensitive workflow used to fail only under unusual manipulation. With AI, unusual manipulation becomes standard operating procedure.
The goal is not to eliminate all risk, which is impossible. The goal is to raise the marginal cost of each additional attempt, so the attacker’s token budget buys less and less progress.
This also reframes what “defense in depth” really means. It is not just multiple controls. It is multiple layers of friction, each one forcing the attacker to spend more search energy to get a reliable signal. In that sense, good security architecture is not a wall. It is a maze with dead ends, decoys, and expensive feedback loops.
Key Takeaways
- Think in terms of search volume, not just skill. If an attacker can cheaply generate thousands of variants, the defense must assume relentless probing.
- Shrink the surface area before you try to monitor it. Fewer paths, fewer privileges, and fewer special cases create fewer opportunities for AI driven exploration.
- Treat token budget as a security variable. The more affordably an attacker can run inference, the more you should expect broad, repeated attempts.
- Build systems that are hard to learn from. Limit noisy feedback, enforce strong invariants, and make failures ambiguous rather than informative.
- Upgrade triage and validation capacity. If you rely on external discovery channels, make sure you can process findings faster than AI can generate them.
The real lesson: security is becoming an economics problem
The deepest implication of all this is that cyber defense is no longer only a contest of technique. It is a contest of economics. AI compresses the cost of exploration, which means more people can search more aggressively for vulnerabilities, for longer, and with less specialized knowledge than before.
That is why a paused bounty program and a rapidly improving cyber capable model belong in the same conversation. One signals the strain on human mediated security channels. The other signals the explosion of machine mediated search. Together they show that the old balance is breaking.
The organizations that adapt will not simply buy better tools or hire more experts. They will redesign systems so that brute force search, whether human or machine, produces less leverage. They will stop assuming that intelligence is rare and start assuming that attempts are cheap.
The most important shift is psychological. We have long treated cybersecurity as a battle of wits. Increasingly, it is a battle over the cost of making one more try.
And once you see that, the question changes. It is no longer, “Can an AI find a bug?”
It is, “How many bugs can it find before the budget runs out?”
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣