The Enterprise AI Problem Is Not Intelligence. It Is Constitutional Design.

Alessio Frateily

Hatched by Alessio Frateily

Aug 24, 2026

11 min read

94%

0

What if the hardest problem in enterprise AI is not getting a machine to produce a correct answer, but getting an organization to trust what happens after the answer is produced?

A powerful language model can read an enormous body of material, retrieve supporting documents, cite its claims, speak multiple languages, and call tools to complete business processes. That sounds like the arrival of an intelligent employee. But intelligence alone does not create an institution. An institution needs identity, permissions, memory, accountability, and rules for changing those rules.

This is where an unexpected comparison becomes useful. Bitcoin is often discussed as a financial system, but its deeper innovation is architectural: it transforms open source software into open source plus state. Anyone can inspect the code, participate in the network, create an identity, and submit a valid state change without asking a central operator for permission.

Enterprise AI faces the inverse challenge. It begins with systems that are highly capable but often opaque, probabilistic, and dependent on centralized access. To become dependable infrastructure, these systems need something like a protocol layer around their intelligence.

The important lesson is not that language models should become blockchains. It is that intelligence without a trustworthy state machine is an unreliable employee, while a state machine without intelligence is merely bureaucracy. The future of production AI will depend on combining both.

From a Smart Model to a Governed System

A language model is good at transforming context into an answer. Give it a long document, a question, and perhaps a set of retrieved passages, and it can produce a useful response. Give it access to tools, and it can move from describing an action to performing one.

But business processes are not made of answers alone. They are made of transitions:

  1. A request is submitted.
  2. The requester is identified.
  3. Relevant information is gathered.
  4. A decision is proposed.
  5. An authorized action is taken.
  6. The result is recorded.
  7. Later participants can inspect or challenge what happened.

Most AI demonstrations emphasize step four. Production systems fail in the other six.

Consider an AI assistant that processes supplier invoices. It may accurately extract the invoice number, identify a mismatch, and recommend payment. Yet an enterprise still needs to know which data it consulted, whether the supplier was authorized, whether the assistant was allowed to approve a payment of that size, which human or service initiated the request, and whether the action can be reversed.

A citation helps answer one question: Where did this claim come from? It does not automatically answer: Who was allowed to use that source, which version was consulted, what instruction governed the decision, and what happened after the recommendation?

This distinction suggests a useful model. Think of an AI application as having two layers:

  • The cognitive layer interprets language, retrieves information, reasons over possibilities, and proposes actions.
  • The constitutional layer defines identity, authority, evidence, state transitions, and acceptable change.

Current AI development has invested heavily in the first layer. The second is often treated as ordinary application plumbing. That is a mistake. In high consequence environments, the constitutional layer determines whether capability can safely become infrastructure.

A model can generate a plausible answer in milliseconds. A trustworthy system must also make the answer accountable months later.

What Bitcoin Reveals About Trust

The most illuminating feature of Bitcoin is not any single cryptographic primitive. It is the way many modest mechanisms combine to produce a public, shared history without a central administrator.

A participant creates a cryptographic identity from a private and public key pair. The private key authorizes an action. The public key allows others to verify it. Transactions are serialized into a precise format, signed, broadcast, grouped into blocks, and preserved as part of a chain of state. The system is not trusted because every participant is honest. It is trusted because valid transitions can be checked by everyone.

This is a radically different approach from asking a central authority to vouch for every event. The network does not need to understand the intentions behind a transaction. It needs to verify whether the transaction obeys the rules.

That idea transfers surprisingly well to AI workflows. An AI system does not need to prove that its internal reasoning is perfectly transparent. In many cases, that is neither possible nor especially useful. It does need to produce verifiable evidence about the external events that matter:

  • Which model and configuration generated the recommendation?
  • Which retrieved documents entered the context?
  • Which user, service, or agent initiated the request?
  • Which tools were called, with which parameters?
  • Which policy permitted the action?
  • What state changed as a result?

This is an event integrity problem. The goal is not to turn every thought into a permanent public record. The goal is to make consequential transitions inspectable and tamper evident.

For example, imagine an AI system that changes a customer’s credit limit. The model may use a long context window to inspect account history, retrieve relevant policy, and compare the customer with similar cases. But the final system should record a signed event containing the request identity, policy version, evidence references, decision, authorization, and resulting state change. An auditor does not need a mystical explanation of every token. The auditor needs a reliable account of what the system saw, what it proposed, which rule allowed it, and what it changed.

This is the difference between explanation and provenance. Explanation attempts to narrate why a system arrived at an answer. Provenance establishes the chain of evidence and authority surrounding an action. For enterprise reliability, provenance is often the more durable asset.

The Paradox of Production: More Capability Creates More Governance

There is a tempting assumption that better models will reduce the need for controls. If the model becomes more accurate, perhaps organizations can loosen the surrounding machinery.

The opposite is often true. As capability rises, the cost of an unauthorized or poorly evidenced action rises with it. A weak model may produce an embarrassing paragraph. A capable model connected to customer records, payment systems, and internal tools can produce a material incident before anyone notices.

Tool use makes this especially clear. A model that only drafts an email is primarily an information system. A model that can send the email, update a record, issue a refund, or deploy code is participating in the organization’s state. Once it can act, every prompt becomes potentially similar to a transaction request.

That does not mean every AI action should require a human signature. It means actions should have explicit authority budgets. A useful policy might distinguish among:

  • Reading public information.
  • Reading confidential information.
  • Drafting a recommendation.
  • Updating reversible internal state.
  • Affecting an external party.
  • Moving money or making an irreversible decision.

The model can be granted broad freedom at the first levels and narrow, conditional authority at the last. This is more practical than treating an AI assistant as either fully autonomous or completely supervised.

Cryptographic identity offers another valuable design pattern. Instead of treating an AI agent as an anonymous process, assign it a distinct identity with scoped credentials. Its actions can then be attributed to a specific agent version, deployment, and authorization policy. If the agent changes, the identity or configuration lineage can reflect that change.

This creates a crucial separation between capability and authority. A model may be capable of calling a payment tool. That does not mean it should possess the authority to do so. In the same way, knowing how to construct a valid transaction does not grant ownership of the funds. Good systems make the boundary explicit.

The Hidden Cost of Open Systems: Complexity and Legacy

The comparison also contains a warning. Open, durable protocols are not simple merely because their basic operations are understandable.

A transaction may look straightforward, but the surrounding system includes signatures, serialization, scripts, block rules, validation logic, historical quirks, and compatibility constraints. Some parts are used constantly. Others exist because they were once envisioned, because a rare case depends on them, or because removing them would break old software.

This is a familiar property of infrastructure: the visible interface is small, but the accumulated contract is enormous.

AI teams should expect the same phenomenon as their systems mature. A retrieval pipeline may begin with a few documents and a prompt. Over time, it acquires source ranking, access filtering, multilingual content, citation formats, caching, model fallbacks, evaluation rules, tool permissions, audit records, and exceptions for old workflows. The system becomes less like a chatbot and more like a living protocol.

The danger is not complexity by itself. The danger is undocumented complexity. In a production AI system, every informal convention eventually becomes a hidden rule. A prompt template may function as policy. A retrieval filter may function as an access boundary. A model version may function as a legal distinction. A manually maintained exception may function as a permanent compatibility promise.

The engineering response should therefore borrow another protocol principle: separate the simple path from the expressive path. Most requests should use a small, well tested set of operations. Advanced capabilities can exist, but they should be isolated, permissioned, and monitored.

For instance, an ordinary customer service request might permit retrieval from approved documentation and generation of a cited response. A specialized escalation might permit access to account tools, but only after a structured authorization step. The existence of a powerful tool should not make it part of every ordinary workflow.

Backward compatibility also deserves deliberate treatment. Changing a model, retrieval strategy, or policy can alter outcomes even when the user interface remains identical. Organizations should preserve enough metadata to reconstruct which system produced a decision. Otherwise, a future audit becomes an archaeological exercise based on incomplete logs.

A Practical Blueprint for Trustworthy AI Infrastructure

The combined lesson can be turned into a concrete architecture. Before deploying an AI workflow, define five objects: identity, evidence, authority, state, and history.

1. Identity

Specify who or what initiated the request. This may be a human, application, service account, or AI agent. Give agents scoped credentials rather than one shared enterprise key. Record the model version, deployment, and relevant configuration.

2. Evidence

Capture the sources that materially influenced the output. In retrieval augmented generation, citations are not decorative footnotes. They are links in an evidence graph. Store document identifiers, versions, access decisions, and retrieval timestamps where the stakes justify it.

3. Authority

Define which actions the agent may propose, simulate, execute, or delegate. Use thresholds and conditions. A recommendation can be automatic while execution requires approval. A reversible action can have a larger budget than an irreversible one.

4. State

Represent the business result explicitly. Do not treat a tool call as the same thing as a successful state change. A payment request, a payment authorization, and a completed payment are different states and should be modeled as such.

5. History

Record a tamper evident sequence of consequential events. This does not require placing sensitive business data on a public blockchain. It may involve signed logs, append only storage, hashes of documents, or independent verification services. The design goal is to make later alteration detectable.

Together, these objects create a verifiable action record. The record need not expose private reasoning or retain every piece of context forever. It should preserve enough information to answer the operational questions that matter.

A useful test is this: if the AI makes a serious mistake on a Friday afternoon, can the organization determine by Monday what it saw, what it was permitted to do, which rule failed, and how to prevent recurrence? If not, the system may be intelligent, but it is not yet production infrastructure.

Key Takeaways

  • Treat AI actions as state transitions, not merely generated text. Map each tool call to the business state it is supposed to change.
  • Separate capability from authority. Give agents distinct identities and narrowly scoped permissions, even when the underlying model is highly capable.
  • Prioritize provenance over theatrical explanation. Track source documents, policy versions, tool parameters, approvals, and outcomes for consequential decisions.
  • Design a simple path and a controlled advanced path. Keep common workflows narrow, tested, and easy to audit. Isolate rare or powerful capabilities.
  • Plan for compatibility from the beginning. Preserve model, retrieval, policy, and configuration metadata so future investigators can reconstruct past behavior.

The central challenge of enterprise AI is often framed as a contest to build a more intelligent model. That contest matters, but it is incomplete. A model is only one participant in a larger system that must coordinate evidence, identity, authority, and memory.

Bitcoin’s deepest lesson is that durable computing systems are not defined only by what they can calculate. They are defined by how a community agrees that a change is valid, how that change becomes part of shared state, and how old participants continue to function as the system evolves.

AI will become genuinely institutional when its actions can be treated in the same disciplined way. Not because every output becomes immutable, public, or cryptographically sealed, but because important actions acquire a verifiable constitutional context.

The question is therefore not simply, “How smart is the model?” It is: When this system acts, what makes the action valid, attributable, and recoverable? The companies that answer that question will not merely have better chatbots. They will have a new kind of software institution: one whose intelligence is flexible, but whose authority is legible.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣