The Equation Comes Before the Automation

Kelvin

Hatched by Kelvin

Aug 10, 2026

11 min read

88%

0

What if the most important skill in the age of AI is not knowing how to produce an answer, but knowing what kind of machine should produce it?

That question exposes a weakness in the popular picture of artificial intelligence. We often imagine AI as a faster employee: give it a task, receive an output, move on. But speed is not the same as intelligence. A system can generate excellent prose, code, analysis, or images while remaining useless at the most consequential step: deciding what problem is actually worth solving.

The same distinction appears in software automation. A workflow can install dependencies, run tests, publish packages, deploy applications, and repeat the process across several operating systems. Yet the workflow does not decide whether the application should exist, which risks matter, or what evidence would count as success. It executes a structure someone has already chosen.

These ideas point to a deeper thesis:

AI is becoming powerful at carrying out equations, while human value is moving toward choosing the equations, the conditions, and the moments when they should run.

This is not an argument that AI is merely a tool for lazy people. It is an argument that tools become powerful only when embedded in a system of judgment. The real danger is not that automation makes us lazy. The real danger is that it lets us automate a badly framed problem so efficiently that we stop noticing the mistake.

The Work Before the Work

Consider a simple request: “Write a report explaining why customer retention fell last quarter.” An AI system can produce a polished report in seconds. It can organize possible causes, describe trends, and recommend interventions. But before any writing begins, several prior questions must be answered.

What does “retention” mean in this business? Is it measured by account renewal, monthly activity, revenue, or continued use of a core feature? Which customers count as comparable? Did the measurement system change? Is the decline caused by product quality, pricing, seasonality, a competitor, or a shift in the customer mix? What decision will the report support?

The report is downstream of those choices. If they are wrong, better language only makes the wrong analysis more persuasive.

This is why knowing the right equation matters more than performing the arithmetic. The equation is not necessarily mathematical. It may be a definition, a causal model, a classification rule, or a sequence of tests. It specifies what counts as relevant and what can be ignored.

A business leader deciding whether retention fell because of onboarding friction is selecting an equation. A physician deciding which symptoms deserve immediate investigation is selecting an equation. An engineer deciding whether a failure is caused by a memory leak or a bad deployment is selecting an equation. Once the structure is right, automation can do much of the remaining work. But automation cannot rescue a structure that never represented reality in the first place.

This creates a useful distinction between two kinds of difficulty:

  • Execution difficulty: producing an answer once the problem is defined.
  • Framing difficulty: defining the variables, relationships, constraints, and evidence that make an answer meaningful.

AI reduces execution difficulty. It may also assist with framing by proposing hypotheses and exposing overlooked possibilities. But responsibility for framing remains especially important because framing determines what the system is allowed to see.

A calculator can solve a complicated expression. It cannot tell you that you entered the wrong numbers. A language model can generate ten plausible strategies. It cannot, by plausibility alone, establish that the strategic question was the right one.

A Workflow Is a Theory of Reality

A software workflow looks procedural, but it is also philosophical. Every trigger encodes an assumption about when change matters. Every condition encodes an assumption about when an action is safe. Every test encodes a definition of acceptable behavior.

A workflow that runs on every push to the main branch says: changes to this branch deserve immediate evaluation. A workflow triggered by a pull request says: proposed changes should be inspected before they enter a more trusted environment. A scheduled workflow says: some work matters even when nobody has manually initiated it. A manual trigger says: the system cannot decide when this action is appropriate, so a person must authorize it.

None of these are merely technical settings. They are decisions about time, trust, risk, and responsibility.

Imagine a deployment workflow with four steps:

  1. Check out the code.
  2. Install dependencies.
  3. Build the application.
  4. Publish it.

This sequence is useful, but it contains an implicit theory: if the code can be built, it is ready to publish. That theory may be false. The build can succeed while security checks fail, database migrations remain incompatible, accessibility has deteriorated, or a critical business rule is broken.

Adding tests improves the workflow, but tests also embody a theory. They measure only the behaviors someone thought to specify. A test suite can be green while users are confused, costs are excessive, or the product is solving no important problem.

The lesson extends directly to AI. When people ask an AI system to “automate customer support,” they are not simply asking it to write replies. They are designing a workflow. What triggers the system? Which messages are classified as routine? What confidence level permits an automatic response? Which cases require escalation? What information may the system access? Who reviews failures? How is success measured?

The prompt is only one step in that larger system. The trigger, context, permissions, validation, fallback, and feedback loop matter just as much.

An automated system is never just a worker. It is a compressed model of what its designer believes matters.

This is why apparently small configuration choices can have large consequences. Running a workflow across multiple operating systems and runtime versions is not just a convenience. It expresses a belief that compatibility across those environments is part of quality. Running a publishing step only on a trusted branch expresses a belief that release authority should be separated from experimentation. Making a workflow manual expresses a belief that some consequences are too significant to delegate entirely.

The same logic applies to AI agents. If an agent can send email, modify records, issue refunds, or deploy code, its workflow must make the boundaries of authority explicit. Intelligence without boundaries is not autonomy. It is unreviewed exposure to consequences.

The Automation Ladder: From Answers to Institutions

A helpful way to think about AI maturity is as a ladder with four levels.

Level One: Generating outputs

At the first level, AI produces text, code, summaries, images, or suggestions. The human supplies a request and evaluates the result. This is where most personal productivity tools live.

The main skill is asking clearly and checking carefully. The system saves time, but it does not yet own a process.

Level Two: Repeating a defined procedure

At the second level, AI is placed inside a repeatable workflow. A form submission triggers classification. A new issue triggers a draft response. A code change triggers tests. The goal is no longer merely to generate an answer, but to generate it at the right time and in the right context.

Here, the quality of the trigger and the surrounding data become as important as the model’s output. A brilliant response to the wrong event is still failure.

Level Three: Managing conditional processes

At the third level, the system chooses among predefined paths. If a request concerns billing, route it to one process. If it involves a safety issue, escalate it. If confidence is low, ask for human review. If tests pass on all required environments, permit deployment.

This is where conditions become central. The system is not only producing outputs. It is applying an operational theory of the organization.

Level Four: Designing new equations

At the fourth level, the system helps identify which variables should matter, which tests are missing, or which workflow assumptions have become obsolete. This is the frontier people often imagine AI has already reached. In practice, it is much harder than producing plausible proposals.

Designing an equation requires knowing what would count as a useful distinction. It requires understanding hidden costs, conflicting goals, and consequences that may not appear in the available data. AI can contribute by searching possibilities, comparing cases, and challenging assumptions. But the human organization still needs a way to decide which possibilities deserve commitment.

This ladder clarifies why “AI can do the task” is an incomplete statement. The relevant question is: At which level can AI perform reliably, and what human judgment remains above it?

A system may be excellent at Level One and dangerous at Level Three. It may draft an empathetic reply but misclassify a legal complaint. It may write a valid deployment script but publish an untested database migration. It may summarize a medical record but omit the one symptom that changes the diagnosis.

Capability must therefore be evaluated within a workflow, not in isolation.

The New Scarce Resource Is Specification

When execution becomes cheap, specification becomes expensive.

Specification means more than writing detailed instructions. It means making the intended relationship between action and outcome explicit. In a team, a good specification answers questions such as: What is the goal? What constraints are nonnegotiable? What evidence would disconfirm our assumption? Which failures are tolerable? Who has authority to approve the next step?

Many organizations have historically relied on tacit knowledge for these answers. An experienced employee “just knows” which customer requests are urgent, which deployments are risky, or which metrics are misleading. Automation forces that knowledge into the open. If it cannot be expressed, it cannot be reliably delegated.

This can feel inconvenient, but it is also an organizational advantage. A workflow that names its conditions makes hidden assumptions inspectable. A test that fails reveals a disagreement about expected behavior. A manual approval step identifies a point where accountability matters. In this sense, automation is not only a labor saving mechanism. It is a machine for discovering vague thinking.

The highest leverage practitioners will therefore cultivate three forms of literacy.

Problem literacy means recognizing the real problem beneath the stated request. “Increase engagement” may actually mean “help users complete a valuable task.” “Reduce support volume” may actually mean “remove recurring product confusion.”

System literacy means understanding how triggers, data, permissions, conditions, and feedback loops interact. It is the ability to see an AI prompt as one component in a larger operational design.

Evaluation literacy means knowing how to distinguish a fluent output from a correct one. It involves constructing tests, edge cases, counterexamples, and escalation rules before trusting automation with consequences.

These skills are not opposed to efficiency. They are what make efficiency safe.

Designing Workflows That Deserve Automation

A practical method is to treat every proposed AI workflow as a small experiment in institutional design. Before automating, write down six elements.

The trigger: What event starts the process? A new message, a code push, a daily schedule, or explicit human approval?

The equation: What problem is the system solving, and how are its important variables defined?

The action: What exactly will the AI or automation do?

The boundary: What may it not do, and what requires escalation?

The test: How will you know the result is acceptable? Include ordinary cases and adversarial or unusual ones.

The feedback loop: How will mistakes be recorded and used to improve the workflow?

Take an internal hiring assistant. A weak design says: “Review applications and rank candidates.” A stronger design specifies that the system extracts evidence related to predetermined competencies, removes irrelevant personal information where possible, provides citations from the application, flags uncertainty, and never makes a final hiring decision. Its outputs are audited for consistency across comparable applications.

The difference is not mainly prompt quality. It is equation quality and workflow quality. The stronger design defines what counts as evidence, limits the system’s authority, and creates a path for correction.

The same method works for code delivery. A mature workflow might run on proposed changes, test across supported environments, perform security checks, create an artifact, and require explicit approval before production release. The important question is not whether every step can be automated. It is whether each automated step has a clear reason to exist and a meaningful failure response.

Automation should be granted according to reversibility. Low consequence, easily reversible actions can be delegated aggressively. High consequence, difficult to reverse actions should require stronger tests, narrower permissions, and human approval. This principle is more useful than a vague distinction between “simple” and “complex.” A task can be technically simple but operationally irreversible.

Key Takeaways

  • Separate framing from execution. Before asking AI to solve a problem, define the variables, success criteria, constraints, and decision the result will support.
  • Treat triggers and conditions as judgments. A scheduled run, branch restriction, approval gate, or escalation rule encodes a theory of when action is appropriate.
  • Evaluate AI inside workflows. Test not only the quality of an answer, but whether the system acted on the right event, used the right context, and stopped at the right boundary.
  • Automate according to reversibility. Delegate routine actions freely when errors are cheap to undo. Add review and stronger validation when consequences are durable.
  • Use automation to expose tacit knowledge. If a process cannot be specified clearly, that is evidence of an unresolved organizational assumption, not merely a technical inconvenience.

The future will not divide people cleanly into those who use AI and those who do not. It will divide organizations according to whether they can design reliable systems around it.

The lazy use of AI is not the use that saves effort. Saving effort is the point of a tool. The lazy use is skipping the difficult act of deciding what the effort is for, then mistaking a polished output for progress.

The most valuable human contribution may therefore look less like doing more tasks and more like designing better conditions under which tasks are done. We will choose the triggers, define the equations, set the permissions, inspect the failures, and decide when the machine must stop.

That is not a retreat from intelligence into administration. It is a shift toward a deeper form of intelligence: the ability to shape the systems that shape our actions. When execution becomes abundant, judgment is no longer the final layer added after the work. It becomes the architecture that gives the work meaning.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣