Why AI Fails at the Middle of the Task, Not the Edges

Jaeyeol Lee

Hatched by Jaeyeol Lee

Jul 19, 2026

9 min read

92%

0

The Strange New Problem with Smart Tools

What if the biggest limitation of AI is not that it is too weak, but that it is unevenly strong?

That sounds like a technical detail, but it changes how we should think about work, skill, and delegation. We are used to judging tools by an average level of competence: can it write, can it code, can it analyze, can it answer questions? Yet in practice, AI behaves less like a general intelligence and more like a landscape with cliffs, plateaus, and sinkholes. It can breeze through one task that seems hard, then stumble on another that looks nearly identical.

This is the core surprise: the future of AI is not just about capability, but about inconsistency. The interesting question is not whether AI can do a task in principle. It is whether the task sits on a smooth part of its frontier, or in one of the jagged gaps where it fails in ways a human would not expect.

That jaggedness matters because most real work is not a single task. It is a chain of subtasks, each depending on the last. When one link in the chain fails, the whole output can collapse. So the real challenge is no longer, “Can AI do this?” It is, “Which parts can it do reliably, which parts does it fake, and which parts do we only think it understands?”


The Danger of Mistaking Fluency for Reliability

AI is often evaluated the way we evaluate a brilliant but unpredictable employee: by how impressive the best answers look. That is a mistake. A model can produce a polished paragraph, a clean piece of code, or a convincing explanation while still being unable to handle a neighboring problem that requires the same kind of reasoning, just in a slightly different form.

This creates a powerful illusion. Because the output is fluent, we assume the underlying competence is broad. But fluency is not the same as robustness. A person who can ride a bike, for example, is usually not confused by a bicycle with a slightly different frame. A machine, by contrast, may master one version and fail on a near variation because the structure of the task moved across an invisible boundary.

Think of a cook who can perfectly prepare scrambled eggs, yet cannot make an omelet because the difference lies in timing, heat, and judgment rather than ingredients. To a human observer, these tasks feel adjacent. To a system with a jagged frontier, they may sit on opposite sides of a cliff. That is why AI can be astonishing in one moment and baffling in the next.

The problem is not that AI is sometimes wrong. The problem is that its wrongness is often discontinuous.

That discontinuity makes it dangerous in a subtle way. When a tool is uniformly mediocre, we compensate easily. When it is uniformly strong, we trust it. But when it is uneven, we are most vulnerable precisely where it appears most capable. We stop checking at the moment of greatest persuasion.


The Jagged Frontier: Why Similar Tasks Are Not Actually Similar

A jagged technological frontier means the boundary of what AI can do does not move outward in a neat circle. Instead, it advances in patches. One patch may cover drafting email, summarizing documents, and generating boilerplate code. Another patch may fail on long context, edge cases, causal reasoning, or tasks requiring stable judgment over many steps.

This explains a pattern many people have observed but not fully named: AI can be startlingly good at the surface form of a task while remaining fragile in its structural core. It can imitate the shape of expertise without possessing the reliable machinery that expertise depends on.

For example, consider legal work. AI may produce a well written memo, identify common contract clauses, and summarize case law. Yet it may miss a hidden exception, misread a jurisdictional nuance, or overlook the practical consequence of a seemingly minor phrase. Those are not small issues. They are the difference between a useful assistant and a liability.

The same is true in software engineering. A model might write a function that passes obvious tests but fails under load, or refactor a file while introducing a subtle dependency bug. It can solve the local problem and fail the system level one. In medicine, education, finance, and operations, the pattern repeats: tasks that seem similar to us are not always similar to the machine.

This is why the frontier is jagged rather than smooth. The obstacles are not random. They arise because AI systems are often better at compression than comprehension, better at pattern completion than durable abstraction, and better at imitation than judgment under uncertainty. Once you see that, the puzzle resolves.

The question becomes less mystical and more managerial: where exactly does the task demand reliability, context sensitivity, or accountability that the system cannot yet provide?


A Better Mental Model: Task Surfaces and Hidden Traps

To use AI wisely, we need a new framework. I think of work as having two layers: the task surface and the task skeleton.

The task surface is what can be visibly approximated. It includes style, structure, vocabulary, common patterns, and standard procedures. AI is often excellent here. It can draft the email, format the report, generate the outline, and even suggest plausible next steps.

The task skeleton is the underlying logic that makes the work actually hold together. It includes exceptions, dependencies, tacit assumptions, domain context, and consequence management. This is where fragile systems break. A surface can look right while the skeleton is wrong.

Here is a simple analogy. Imagine a beautifully painted bridge made of cardboard. From a distance, it resembles a real bridge. It has arches, railings, and symmetry. But if the load bearing structure is wrong, the first truck to cross will reveal the truth. AI often excels at painting the bridge. Human judgment is still needed to test whether anything can safely travel across it.

This distinction explains why some tasks can be heavily automated while others cannot be delegated wholesale. An AI may be trusted to draft a proposal, but not to finalize the business strategy. It may summarize customer feedback, but not decide the product roadmap. It may suggest code, but not own production reliability. The difference lies not in how polished the output looks, but in how much hidden complexity must be resolved before the work is safe.

When evaluating AI, ask not whether the output looks right, but whether the hidden skeleton has been validated.

This is the practical test that matters. The more a task depends on invisible constraints, the more dangerous it is to rely on output alone. The more it depends on stable patterns that are easy to check, the more AI can help. The frontier is jagged because surface resemblance is cheap, while structural correctness is expensive.


How the Jagged Frontier Changes the Way We Work

If AI were uniformly improving, the response would be simple: automate more. But a jagged frontier demands something more intelligent than blanket enthusiasm or blanket skepticism. It requires selective delegation.

That means dividing tasks into what AI can draft, what it can diagnose, and what it must never be allowed to decide alone.

A useful rule is this:

  1. Drafting tasks are usually low risk. AI can write summaries, first passes, brainstorming lists, and routine explanations.
  2. Checking tasks are moderate risk. AI can flag inconsistencies, generate alternatives, and help review work, but not be the final authority.
  3. Judgment tasks are high risk. These involve ambiguous tradeoffs, moral responsibility, long horizon consequences, and accountability for failure. Here, AI should assist, not decide.

This framework is useful because it focuses attention on the real fault line: not whether a task is easy or hard in the abstract, but whether its failure would be obvious, recoverable, and locally constrained. A typo in a newsletter is recoverable. A mistaken assumption in a medical recommendation is not.

The jagged frontier also changes how organizations should build workflows. Instead of asking employees to “use AI,” leaders should map which steps are suitable for generation, which require verification, and which require escalation. The best systems will not be those that maximize AI involvement. They will be those that place AI exactly where its strengths are most reliable and its failures most contained.

That is a different philosophy of productivity. It is not automation at all costs. It is designing around asymmetry.


The New Skill Is Not Prompting, It Is Boundary Detection

People often talk about prompting as the key AI skill. Prompting matters, but it is not the deepest one. The more valuable skill is boundary detection: knowing where the model’s competence ends, where the task’s hidden complexity begins, and where human oversight becomes non negotiable.

This skill resembles good mountain navigation more than good typing. A climber does not just move forward aggressively. They read the terrain, identify unstable ground, and choose a route based on the shape of the hazard. Likewise, a good AI user does not ask the model to do everything. They learn to recognize the cliffs.

Boundary detection has three parts:

  • Recognize brittle areas: tasks involving rare exceptions, multi step dependency chains, or ambiguous meaning.
  • Test adjacent variation: if AI can do version A, try version B that is slightly different. Failure on nearby versions is a sign of jaggedness.
  • Demand proof, not prose: when stakes are high, require citations, checks, tests, or independent verification rather than elegant explanation.

This matters because the most persuasive failure is the one that comes with confidence. AI can produce an answer that sounds complete while leaving out the very detail that determines whether the answer is safe. The user who knows how to probe that boundary has an advantage that casual users will not.

The deeper insight is that AI literacy will not mainly be about writing better prompts. It will be about developing a healthy suspicion of smoothness. The smoother the output, the more important it becomes to ask what was not tested.


Key Takeaways

  1. Do not judge AI by average performance. Judge it by how it behaves near the edges of a task, especially where failure would be costly.
  2. Separate surface from skeleton. A convincing output may only reflect surface competence, not structural reliability.
  3. Use AI for drafting and narrowing, not blind decision making. It is strongest when generating options and weakest when accountability and judgment matter most.
  4. Probe adjacent variation. If the model can do one version of a task, test near variants to expose hidden brittleness.
  5. Build workflows with verification built in. Treat AI output as a proposal that still needs checks, tests, or human review.

The Real Future of Work Is Knowing Where Not to Trust the Machine

The most important lesson from the jagged frontier is not that AI is unreliable in some vague sense. It is that reliability itself is unevenly distributed. That means the decisive skill of the next era will be judgment about boundaries, not blind faith in capability.

In the early days of a new technology, people ask what it can do. Later, the better question becomes what it can do consistently, under pressure, across variation, and with consequences attached. That is where the difference between novelty and infrastructure becomes clear.

AI is not one thing. It is a patchwork of strengths and blind spots, brilliance and brittleness. If we mistake that patchwork for a smooth intelligence, we will overdelegate in the wrong places and underuse it in the right ones. But if we learn to see the jagged frontier for what it is, we gain something better than enthusiasm: discernment.

And discernment is the skill that turns a powerful tool into a trustworthy one.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣