The Skill AI Cannot Automate: Knowing What Is Wrong

Kazuki Nakayashiki

Hatched by Kazuki Nakayashiki

Aug 23, 2026

10 min read

94%

0

What if the biggest danger of artificial intelligence is not that it will produce bad work, but that it will produce work too quickly for us to notice why it is bad?

A machine can now draft an email, propose ten business ideas, summarize a book, design an image, or suggest a weekend itinerary in seconds. This has made creation cheaper. It has not made judgment cheaper. In fact, as the supply of possible answers expands, the ability to recognize the right answer becomes more valuable.

This creates a strange modern asymmetry: we have more access to ideas than ever, but no corresponding increase in our ability to evaluate them. The central question is no longer simply, “What can I make?” It is, “What deserves to survive?”

That question connects two seemingly separate developments. First, great work depends on a critical eye that can detect flaws, reduce excess, and identify what matters. Second, people are increasingly using AI to find information, generate ideas, and complete tasks, especially younger people who are adopting it as a daily thinking companion. Together, these developments reveal a new literacy: the ability to use machines for abundance without surrendering the human responsibility of selection.

Creation Is Becoming Cheap. Selection Is Becoming the Bottleneck.

For most of history, making something required enough effort to impose discipline. A person writing a report had to research, organize, draft, and revise. A person sketching a product had to decide which concepts were worth drawing. A person composing a message had to live with the limits of time, attention, and skill.

AI removes much of this friction. That is its extraordinary promise. Someone with a vague notion can ask for variations, alternatives, outlines, images, explanations, and counterarguments. Young adults, in particular, are already using AI to come up with ideas at much higher rates than older adults. The cultural shift is not merely technological. It is psychological: more people now experience thinking as a process of requesting possibilities.

But possibility is not quality. A restaurant with a thousand dishes is not necessarily better than one with twelve. A novelist who generates fifty plot ideas has not necessarily moved closer to a good novel. A manager who receives twenty strategic recommendations still has to determine which one understands the actual problem.

This is where the critical eye becomes indispensable. Criticism is often misunderstood as negativity, taste policing, or post hoc commentary. At its best, criticism is a form of applied perception. It notices the gap between what a thing claims to be and what it actually does. It asks where attention is wasted, where the experience breaks, where an assumption fails, and where a small change could transform the whole.

A critic does not merely say, “This is bad.” A useful critic can say: “The opening promises urgency, but the middle becomes procedural. The product solves a technical problem while creating a social one. The sentence is correct, but its rhythm makes the idea feel timid.” Such judgments convert vague dissatisfaction into a map for improvement.

When creation becomes abundant, the scarce resource is not imagination. It is informed refusal.

The refusal matters because every choice carries an opportunity cost. To keep one feature is to make another less visible. To include one argument is to give it space that could have gone to another. To accept a plausible answer is to decline the search for a more precise one.

AI increases the number of doors we can open. Judgment determines which rooms are worth entering.

The Virtuous Loop: Make, Critique, Revise

The relationship between creativity and criticism is often framed as a conflict. The creator wants encouragement; the critic finds defects. The builder wants momentum; the evaluator introduces hesitation. Yet the most effective creative systems treat these forces as complementary.

A critical eye without the ability to make anything can become sterile. It may identify flaws without understanding the constraints involved in solving them. But making without criticism is equally limited. It produces drafts that are protected from the very pressure required to become strong.

The productive sequence is not creation followed by a final inspection. It is a continuous loop:

  1. Generate a concrete attempt.
  2. Inspect what is not working.
  3. Explain the nature of the failure.
  4. Revise in response to that explanation.
  5. Repeat until the important weaknesses have been addressed.

This loop is more powerful than either inspiration or analysis alone. It turns criticism from a verdict into an engine.

Consider a simple example. Someone asks an AI system to draft a note declining a meeting. The first version is polite, concise, and grammatically clean. It is also vague. It says the sender is “unable to attend at this time” and hopes to “connect in the future.” A passive user accepts the draft because nothing is visibly wrong. A critical user notices that the message avoids the actual decision. They revise the instruction: decline clearly, preserve the relationship, and offer a specific alternative only if one is genuinely wanted.

The second draft is better not because the machine suddenly became intelligent, but because the human supplied a sharper standard. The quality of the output was limited by the quality of the dissatisfaction brought to it.

This pattern applies to design, research, software, teaching, and ordinary personal decisions. If an AI system produces a travel plan, the key question is not whether the itinerary contains attractive locations. It is whether it understands the traveler’s real constraint: limited mobility, a fear of crowds, a child who needs predictable meals, or a desire to avoid turning rest into another assignment.

A critical eye searches for the hidden problem beneath the stated request.

That is why simply knowing that something is wrong is not enough. The deeper progression is:

  • Detection: Something feels off.
  • Diagnosis: The problem is identified precisely.
  • Direction: A better standard is defined.
  • Decision: One revision is chosen over the others.

AI can assist with detection and diagnosis. It can compare versions, expose contradictions, test edge cases, and suggest alternatives. But direction and decision remain deeply human because they depend on priorities. What counts as better depends on purpose, audience, values, risk, and context.

A machine may tell you that a paragraph is repetitive. It cannot, by that fact alone, determine whether repetition is a flaw or a deliberate incantation. It may identify that a product feature is rarely used. It cannot decide whether the feature is strategically important because it signals trust, safety, or institutional seriousness.

The Risk of Outsourcing the Inner Editor

The most visible uses of AI today involve information, work tasks, writing, images, entertainment, shopping, and companionship. These uses differ, but they share a tempting premise: let the system handle the cognitive friction.

Sometimes that is exactly right. There is no virtue in manually performing a task that a machine can do reliably. Automating transcription, formatting, routine comparison, or first drafts can free attention for more meaningful work.

The danger begins when we outsource not only the labor of thinking, but also the standards by which thinking is judged. A person who asks AI for an answer and accepts the first fluent response has not really delegated a task. They have delegated responsibility.

This is especially risky because fluency disguises weakness. A badly written answer announces its problems. An elegant but shallow answer can pass unnoticed. The better AI becomes at sounding coherent, the more important it becomes to ask whether coherence is connected to truth, usefulness, or wisdom.

Imagine a student using AI to generate possible thesis statements. This can be educational if the student compares them, rejects several, and explains why one has greater explanatory power. It can be intellectually corrosive if the student chooses the most polished sentence without understanding the argument it implies. In the first case, AI becomes a sparring partner. In the second, it becomes a substitute for intellectual ownership.

The same distinction appears in creative work. A person may ask for ten logo concepts and discover an unexpected direction. That is expansion. But if the person chooses the most attractive option without asking whether it communicates the company’s character, the system has not improved the decision. It has merely made preference feel like judgment.

The inner editor is not an instinct that some people possess and others lack. It is a practice of making standards explicit. What must this accomplish? For whom? At what cost? What failure would matter most? What should be removed even if it is impressive?

These questions create resistance against what might be called plausibility capture: the tendency to mistake an answer that sounds reasonable for an answer that has earned trust.

The more persuasive the tool becomes, the more deliberately you must preserve the right to say no.

This does not mean treating AI as an enemy or distrusting every output. It means assigning it a proper role. Use it to widen the field, challenge assumptions, expose weaknesses, and accelerate revision. Do not ask it to decide what matters before you have decided what matters yourself.

A Practical Model for AI Assisted Judgment

A useful way to work with AI is to divide a project into four distinct jobs: expansion, examination, selection, and ownership.

During expansion, ask for possibilities. Request competing explanations, unusual approaches, examples from different domains, or ways to solve the problem under different constraints. The goal is variety, not immediate correctness.

During examination, become adversarial in a constructive way. Ask what each option assumes, who might be harmed by it, what evidence would disconfirm it, and where it could fail in practice. Ask the system to criticize its own recommendation, then look for weaknesses in that criticism too. The tool is useful here as a tireless source of objections, not as the final judge.

During selection, impose a ranking system. For a hiring process, the criteria might be demonstrated ability, learning speed, and collaboration. For a product, they might be clarity, reliability, and emotional appeal. For an article, they might be originality, explanatory power, and memorability. Without criteria, a large set of options creates confusion rather than freedom.

During ownership, make the final work answerable to a person. Can you defend the choice without saying that the system recommended it? Can you explain what you changed and why? Would you still stand behind the result if the machine disappeared from the record?

This model also helps distinguish productive criticism from compulsive fault finding. The goal is not to find an endless number of defects. It is to identify the defects that interfere with the purpose of the work. A sandwich does not need to become a masterpiece. But it can still be improved by noticing that the bread overwhelms the filling, the sauce makes it soggy, or the texture lacks contrast.

The point is not perfection. It is deliberate improvement.

In a workplace, this might mean asking an AI system to draft a proposal, then requiring the team to identify its three riskiest assumptions before editing its prose. In education, it might mean having students submit both an AI assisted answer and a short account of which suggestions they rejected. In personal planning, it might mean asking for options, then writing down the constraint that matters most before choosing among them.

The important habit is simple: never move directly from generation to acceptance. Insert judgment between them.

Key Takeaways

  • Use AI for abundance, not authority. Ask it for alternatives, angles, examples, and objections. Treat its first answer as raw material.
  • Name the failure precisely. Replace “This does not work” with a diagnosis such as “It solves the stated problem but ignores the user’s main constraint.”
  • Define your standards before comparing options. Quality is not a property floating inside an answer. It is a relationship between an answer, a purpose, and a set of values.
  • Build a revision loop. Generate, inspect, diagnose, revise, and repeat. The first draft is not the product. It is an instrument for discovering what you actually think.
  • Preserve ownership. If you cannot explain why the final choice is right, you have not delegated a task. You have delegated judgment.

The broad adoption of AI will not make critical thinking obsolete. It will expose how much of our supposed thinking was merely selection by convenience. When every person can summon a competent draft, an attractive image, or a plausible explanation, the distinguishing skill will be the capacity to see beyond competence.

The future will belong neither to pure creators nor to pure critics. It will belong to people who can move between making and questioning without confusing either one for the whole act of thought. They will use machines to produce more possibilities, then apply human standards to eliminate most of them.

The deepest advantage will come from a habit that sounds almost modest: noticing what is wrong, understanding why it is wrong, and caring enough to fix it. In an age of instant answers, that habit is not a brake on intelligence. It is what makes intelligence count.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣