The Organization That Can See Beneath Its Labels

Simon Tyrrell

Hatched by Simon Tyrrell

Aug 14, 2026

12 min read

92%

0

What if the greatest danger of generative AI is not that it will make bad decisions, but that organizations will continue making important decisions through crude proxies?

For decades, companies have used credentials as a shortcut for ability. A degree stood in for knowledge, a job title stood in for experience, and a department stood in for accountability. These shortcuts were imperfect, but they made large organizations easier to manage.

Generative AI challenges that entire operating system. It can identify skills hidden in messy language, connect tasks to capabilities, generate credible software and scientific hypotheses, and operate across boundaries that organizations traditionally treated as separate. Yet the same technology creates novel risks precisely because those boundaries are becoming less reliable.

This creates a deeper question than whether companies should adopt AI: Can an organization become more intelligent without becoming less governable?

The answer depends on replacing proxy based management with capability based management. That shift matters in hiring, but it also provides a powerful way to think about AI risk, accountability, and organizational design.

The hidden connection between hiring and AI governance

Consider two familiar decisions.

A recruiter must decide whether a candidate can solve a difficult operational problem. Instead of examining the candidate’s actual capabilities, the recruiter may use a degree, a previous employer, or a job title as evidence. These signals are convenient, but they are indirect. A person may have learned the relevant skill on the job, through independent study, or in a role whose title hides the complexity of the work.

Now consider a company deciding whether an AI use case is safe. It may classify the use case by department, vendor, or broad category. A tool used by marketing may be treated as low risk, while a tool used by human resources may be treated as high risk. But the department is not the risk. The risk comes from what the system can do, what data it touches, whose interests it affects, and what happens when its output is wrong.

In both cases, the organization is tempted to govern through labels instead of capabilities.

A degree is a label for presumed competence. A job title is a label for presumed responsibility. A department is a label for presumed risk. Generative AI is unusually powerful because it can look beneath these labels. It can tag unstructured information, recognize patterns in descriptions of work, and connect scattered evidence into a more detailed map of what people and systems actually do.

That is why the future of AI governance and the future of skills based hiring are more connected than they first appear. Both require organizations to answer the same question: What is really happening beneath the category?

The mature organization does not ask only who owns a decision. It asks what capability is being exercised, what evidence supports it, and what could happen if it fails.

This is not merely a technical upgrade. It is a change in the unit of management.

From organizational labels to capability maps

Most organizations are built around boxes. There are functions, teams, levels, roles, and reporting lines. These structures are useful for budgeting and accountability, but they are poor descriptions of how value is actually created.

A product manager may perform research, write specifications, interpret data, negotiate priorities, and explain tradeoffs to executives. A customer service specialist may diagnose technical problems, calm frustrated people, identify recurring defects, and improve internal documentation. Their official titles capture only a small portion of their contribution.

Generative AI can help build what might be called a capability map: a living representation of the tasks, judgments, knowledge, and behaviors that make up work. Instead of asking whether a person has the right credential, the map asks which capabilities are present and what evidence demonstrates them. Instead of asking whether an AI application belongs to a particular department, the map asks which actions it performs and which decisions it influences.

Imagine a company introducing an AI assistant that summarizes customer complaints. On the surface, this looks like a simple productivity tool. A capability based analysis would ask several more precise questions:

  1. Does the system merely organize text, or does it recommend which complaints deserve escalation?
  2. Does it process public comments, private customer records, or sensitive personal information?
  3. Who verifies the summary before it affects a decision?
  4. What kinds of errors are likely, and who bears the cost of those errors?
  5. Does the system replace a task, accelerate a task, or change who is capable of performing it?

These questions reveal that risk is not a property of the tool’s name. It is a property of the tool’s role in a chain of action.

The same map can improve workforce decisions. Rather than searching for candidates with a specific title, a company could search for people who have repeatedly performed the component tasks required by the role. Someone who never held the title of operations analyst may nevertheless have gathered evidence, detected anomalies, communicated findings, and improved a process. The map makes that experience legible.

This is the promise of an ontological cloud for work: a shared vocabulary connecting tasks, skills, behaviors, and outcomes. Such a vocabulary would allow an organization to see that the same capability may appear under different titles, and that the same title may conceal radically different capabilities.

But visibility is not the same as truth. A system that extracts skills from text can also reproduce the biases embedded in that text. Profiles may exaggerate achievements. Job descriptions may encode outdated assumptions. Public language may be more abundant for privileged groups than for people whose work has been informal, local, or invisible online.

Capability mapping therefore requires evidence, not just tagging. The crucial distinction is between inferred capability and demonstrated capability. A model may infer that someone possesses strategic thinking because certain words appear in a profile. A stronger process would invite the person to solve a representative problem, describe a past decision, or provide work samples that can be evaluated against explicit criteria.

Generative AI can make the map richer. It cannot make the map automatically fair.

Speed and safety are not opposites

Organizations often frame AI adoption as a choice between moving quickly and managing risk. Move quickly, and governance may become an afterthought. Govern carefully, and experimentation may slow until the opportunity disappears.

This is a false opposition when governance is designed well. The real distinction is between slow governance and high resolution governance.

Slow governance relies on broad committees, vague categories, and approval processes that treat every use case as equally mysterious. High resolution governance breaks a use case into its actual capabilities and assigns controls according to the consequences of each one.

A system that drafts an internal meeting summary and a system that recommends who should be hired may both use a language model. They should not receive the same level of scrutiny. The difference is not that one is called administrative and the other human resources. The difference is that one produces a revisable artifact, while the other may alter a person’s access to opportunity.

This suggests a practical risk equation:

Risk is shaped by capability, consequence, exposure, and reversibility.

Capability asks what the system can do. Consequence asks what is at stake if it is wrong. Exposure asks what data, users, and external systems are involved. Reversibility asks whether a mistake can be detected and repaired before harm compounds.

A low consequence, highly reversible use case can often be tested rapidly with modest controls. A high consequence, difficult to reverse use case requires stronger human review, clearer documentation, restricted data access, monitoring, and a defined process for appeal or correction.

This model also clarifies why governance cannot be delegated entirely to a central risk office. The people closest to the work understand the context in which errors become dangerous. Technical specialists understand model behavior and security. Legal and compliance teams understand obligations. Senior leaders decide how much uncertainty the organization is willing to accept. Effective governance combines these perspectives without making every decision travel through the same bottleneck.

The organizational challenge is to create a structure that can say yes safely, not merely a structure that can say no defensibly.

That requires four operating habits.

First, conduct a rapid inventory of AI exposure. Find the tools employees are already using, including informal uses that never passed through procurement. Shadow adoption is often more dangerous than approved experimentation because it has no owner, no documented data flow, and no clear response when something goes wrong.

Second, classify use cases by materiality rather than novelty. A technically impressive application is not necessarily a high risk application. A simple automation can be dangerous if it influences credit, employment, health, safety, or access to essential services.

Third, assign controls to failure modes. If hallucination is the concern, require source checking and human review. If sensitive data exposure is the concern, restrict inputs and access. If discrimination is the concern, test outcomes across groups and provide a way to challenge decisions. Governance becomes faster when it is specific.

Fourth, train users in judgment, not just button pressing. People need to understand what a system is authorized to do, what it cannot reliably do, and when a seemingly efficient output requires skepticism.

The danger of automating the old proxies

There is a darker possibility in the shift toward capability based organizations: companies may use AI to make their old shortcuts more efficient.

A recruiting system might search for skills rather than degrees, but define skills using the language of previous successful hires. A risk system might analyze use cases in detail, but assign higher risk to teams that have historically received more scrutiny. A model might discover that certain phrases predict promotion, then reward people who have learned to imitate those phrases rather than people who create genuine value.

This is the automation of inherited judgment. It looks objective because the process is data driven, but the data may simply preserve yesterday’s preferences at greater scale.

The antidote is not to reject models. It is to make the organization’s assumptions visible and contestable. Every capability map should have a provenance layer: where did this definition come from, whose experience shaped it, and what evidence would cause us to revise it?

Every high consequence AI system should also have a challenge layer. Can an affected person ask why a recommendation was made? Can a manager override it with a documented reason? Can the organization identify systematic errors? Can a candidate demonstrate capability through an alternative route if the system fails to recognize their experience?

These mechanisms do more than protect individuals. They improve the quality of the map. A map becomes more accurate when the people represented in it can correct it.

There is an important cultural implication here. In a credential based organization, authority flows from recognized status. In a capability based organization, authority must be connected to evidence and responsibility. That can be uncomfortable, because it exposes the difference between being senior and being right, between owning a process and understanding it, and between having access to information and knowing how to use it.

Generative AI accelerates this discomfort by making hidden competence easier to detect and hidden incompetence harder to conceal. It can help a talented employee articulate knowledge that was previously trapped in experience. It can also expose how often institutions confuse familiarity with mastery.

Building the capability based enterprise

The most useful first step is not to purchase another AI platform. It is to choose one important workflow and describe it at the level of actual work.

Take hiring for a technical support role. List the recurring tasks: diagnosing problems, asking clarifying questions, searching documentation, explaining solutions, recognizing when to escalate, and learning from unusual cases. Define what strong performance looks like for each task. Then identify what evidence can demonstrate it, such as a work sample, a structured interview response, or observed performance in a realistic simulation.

Now apply the same method to an AI use case. If a system helps screen applicants, specify exactly what it may do and what it may not do. It may organize evidence against published criteria. It may not infer motivation from personality cues or reject a candidate without review. Monitor not only efficiency, but also false negatives, demographic patterns, and the quality of human overrides.

This creates a useful cycle:

  1. Decompose the work. Identify tasks, judgments, inputs, outputs, and affected people.
  2. Define the capability. Describe what good performance means in observable terms.
  3. Collect varied evidence. Use work samples, outcomes, context, and human testimony, not one proxy.
  4. Match controls to consequences. Increase oversight as potential harm and irreversibility increase.
  5. Learn from exceptions. Treat appeals, overrides, and failures as information that improves the system.

The result is more than a safer AI program or a fairer hiring process. It is an organization that knows what it is actually capable of doing.

Key Takeaways

  1. Replace labels with capabilities. Evaluate people and AI systems by the tasks they can perform, the judgments they exercise, and the evidence behind those claims.
  2. Separate inferred skill from demonstrated skill. Use generative AI to discover possible capabilities, then validate them through work samples, outcomes, and structured evaluation.
  3. Govern consequences, not categories. Classify AI use cases according to exposure, impact, and reversibility, rather than relying on department names or broad technology labels.
  4. Build challenge and correction into the system. People should be able to question important recommendations, supply additional evidence, and correct inaccurate representations.
  5. Use governance to accelerate responsible experimentation. Clear boundaries, predefined controls, and accountable owners allow low risk use cases to move quickly while focusing scrutiny where mistakes matter most.

The central promise of generative AI is often described as the ability to produce more: more code, more text, more designs, more analysis. Its deeper organizational promise is the ability to perceive more: the skills hidden inside job histories, the risks hidden inside workflows, and the assumptions hidden inside familiar categories.

That promise will be realized only if organizations are willing to look beneath their own labels. The companies that thrive will not be those that automate every decision, nor those that protect every old process from change. They will be those that can distinguish a credential from a capability, an output from a judgment, and a fast decision from a reckless one.

The future of responsible AI is therefore not just a technical problem. It is a test of whether institutions can become honest about how decisions are really made. Once an organization learns to see work in terms of capabilities and consequences, speed and safety stop being rival ambitions. They become two benefits of the same thing: knowing what you are doing.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣