The Cost of Pretending Context Does Not Matter
Hatched by Profuse Habits
Sep 13, 2026
10 min read
0 views
91%
What do a search engine that answers a question about Chrome with a self serving AI response and an actor who describes science fiction as a space for colorblind reinvention have in common?
At first, almost nothing. One is a problem of technology and advertising. The other concerns race, casting, identity, and artistic freedom. Yet both expose the same modern temptation: the desire to appear neutral while quietly deciding whose interests, histories, and realities will count.
The central issue is not whether an answer is generated by a machine or performed by a person. It is whether the system producing that answer admits the context shaping it. A search engine may present promotion as information. An artist may present the refusal to see race as imaginative liberation. In both cases, the claim of neutrality can conceal a particular arrangement of power.
The danger is not simply that the answer may be wrong. It is that the audience may lose the ability to recognize what has been omitted, redirected, or made invisible.
The Neutrality Trick
Neutrality sounds like fairness because it promises to remove preference from the process. If a search engine gives you an answer rather than a list of links, it can appear more efficient and objective. If an actor says she can become any character because she does not see color or gender, the statement can appear generous and artistically expansive.
But neutrality is never merely the absence of a point of view. It is often a point of view that has become so familiar that it no longer announces itself.
Consider the difference between a library and a tour guide. A library contains many books, but it does not necessarily tell you which one is reliable, current, relevant, or quietly shaped by an interested party. A tour guide makes selections and interpretations visible. The guide can still mislead you, but at least you know that someone is guiding you.
Traditional search results, for all their flaws, offered a rough version of the library model. You received multiple pages, saw competing claims, and had some responsibility for judging them. Generative search moves toward the tour guide model, but often hides the guide. It presents a smooth answer that can blend retrieval, inference, advertising, and corporate strategy into one confident voice.
The problem becomes especially serious when the system has something to gain from your belief. If a company benefits when its own product is treated as the natural solution, then an answer about that product is not simply an answer. It is also a commercial encounter. The interface may look like a neutral window, while functioning as a salesperson standing just outside the frame.
The same logic applies to cultural representation. Saying that one is colorblind can sound like a refusal to reduce people to categories. But if a role carries a specific historical, racial, or political meaning, ignoring those dimensions does not make them disappear. It can instead preserve the assumption that the default performer, perspective, or audience is universal.
When context is erased, power does not disappear. It becomes harder to see.
That is the neutrality trick: treat a choice as if no choice had been made. Treat a perspective as if it were simply reality. Treat a commercial objective as if it were helpfulness. Treat a historically marked identity as if it were an irrelevant detail.
The Missing Context Is Often the Main Information
We tend to think of context as supplementary. The answer is the important part, and context is the footnote. In practice, context often determines what the answer means.
Imagine asking, “Which browser should I use?” An answer that names a browser may be factually defensible, but its value depends on several questions. Is the recommendation based on privacy, speed, compatibility, market share, or the interests of the platform delivering it? Does the system know that the user is asking for a general recommendation, troubleshooting help, or information about a competitor?
A recommendation without its criteria is not neutral. It is incomplete in a strategically convenient way.
Now consider a casting decision involving a historical figure whose identity is central to the public meaning of her life. The question is not only whether an actor is talented enough to imitate the person. It is also what the role represents, who has historically been excluded from playing such figures, and whether the production is using imaginative transformation to expand representation or to avoid it.
This is why the idea of “just acting” can be misleading. Acting always involves transformation, but transformation takes place inside a social world. An actor may reinvent herself for a fictional role without difficulty. A production depicting a real person, especially one whose racial identity shaped her life and work, makes a different kind of claim. It is not merely imagining a character. It is interpreting a history.
The missing context therefore acts like an invisible variable in an equation. Remove it, and the result may look clean while becoming less accurate.
A useful mental model is the context budget. Every answer, recommendation, or representation has a limited amount of attention available. When context is omitted, that budget does not vanish. It is reallocated. The space may be filled by convenience, profit, habit, or the assumptions of whoever controls the platform.
A concise AI answer may save you ten seconds while hiding its incentive structure. A supposedly universal artistic vision may offer creative freedom while transferring the cost of invisibility to people whose identities are treated as optional.
The key question is not, “Can this system operate without context?” It plainly can. The better question is, “Who benefits when context is treated as unnecessary?”
Two Forms of False Helpfulness
The search interface and the performance culture appear different because one is informational and the other symbolic. Yet they can be analyzed through the same three part structure.
First, both promise frictionlessness. The search engine wants to remove the inconvenience of browsing, comparing, and judging. The colorblind artistic ideal wants to remove the friction of identity, history, and political disagreement from the creative process. Both promise a world in which the desired result arrives without the difficult interpretive work.
Second, both conceal selection. An AI answer selects which facts, links, products, or interpretations to foreground. A casting decision selects whose body and experience will stand in for a historical identity. The selection is then softened by language suggesting that no meaningful selection occurred.
Third, both distribute risk asymmetrically. If a search answer favors a company’s product, the user may receive distorted guidance, while the company gains attention or market share. If a culturally specific role is assigned without sufficient regard for representation, the production gains creative or commercial convenience, while the excluded community bears the symbolic cost.
This is false helpfulness: behavior that appears to reduce the burden on the user while moving the burden elsewhere.
A useful test is to ask four questions whenever something presents itself as simply helpful:
- What labor is being removed? Is the system saving time, or preventing scrutiny?
- What choice is being hidden? Which alternatives were not shown or considered?
- Who pays for the convenience? Is the cost financial, cultural, political, or epistemic?
- Who gets to define success? Is success accuracy, profit, inclusion, artistic freedom, or something else?
These questions do not require rejecting AI, advertising, artistic experimentation, or universal ideals. They require making the tradeoffs visible.
Why “Just Treat Everyone the Same” Is Not Enough
Equality is often imagined as identical treatment. But identical treatment can produce unequal outcomes when people enter a situation with different histories and vulnerabilities.
Suppose a search engine gives every product the same visual treatment, but places its own product first because that placement is controlled internally. The interface looks consistent. The underlying opportunity is not.
Suppose a production announces that it is choosing actors without regard to race. That may sound like a fair rule. But if the industry has long offered some groups abundant access and others little access, ignoring race can preserve the effects of that history while denying that history exists.
This distinction is between procedural neutrality and substantive fairness. Procedural neutrality asks whether the same rule was announced for everyone. Substantive fairness asks whether the rule recognizes the real conditions under which people encounter it.
The distinction matters beyond technology and entertainment. A workplace that says it promotes only merit may ignore unequal access to mentorship. A school that uses the same test for every student may ignore unequal preparation. A news organization that gives all claims equal time may create false equivalence when evidence is profoundly unequal.
In each case, the language of sameness can protect the status quo. The rule appears impartial because it refuses to acknowledge the conditions that made impartiality necessary in the first place.
This does not mean every identity claim should override every other consideration. It means that fairness requires relevance. Sometimes race is irrelevant. Sometimes it is the central fact. Sometimes an answer about a product needs no discussion of corporate incentives. Sometimes those incentives are the most important part of the answer.
The mature position is not to see identity or power everywhere. It is to notice when they are already shaping the situation, whether or not the institution names them.
A Better Model: Accountable Mediation
The alternative to false neutrality is not constant suspicion. It is accountable mediation.
Every system that filters reality should make three things legible: its standpoint, its selection process, and its accountability when it gets things wrong.
For search and AI systems, this could mean clearly distinguishing retrieved information from generated synthesis, recommendations from paid placement, and confidence from certainty. It could mean showing competing sources instead of compressing disagreement into a single polished voice. It could mean treating the user as a participant in judgment rather than a passive recipient of conclusions.
For cultural production, accountable mediation means acknowledging that representation is not only a question of an individual performer’s talent or intentions. It involves the meaning of the role, the history of access, the distribution of opportunities, and the voices included in the process. Artistic freedom becomes stronger, not weaker, when it can explain what it is doing and why.
The goal is not to eliminate mediation. That is impossible. A search engine mediates by ranking. A studio mediates by casting. A person mediates reality through language, memory, and attention. The goal is to prevent mediation from disguising itself as nature.
Here is a practical principle: the more consequential the interpretation, the more visible its assumptions should be.
A casual restaurant recommendation does not need a dissertation about ranking criteria. A medical answer, a political claim, a financial recommendation, or a culturally loaded representation deserves more disclosure. Transparency should scale with consequence.
This principle also helps us avoid an opposite error: demanding endless explanation for every minor choice. Not every interface decision is a moral crisis, and not every creative decision carries the same historical weight. Accountability is not the same as paralysis. It is proportionate responsibility.
Key Takeaways
-
Ask what has been omitted, not only what has been presented. A polished answer may be less trustworthy when its sources, incentives, or alternatives remain invisible.
-
Separate convenience from neutrality. Something can save time while still steering your judgment toward a commercial or cultural outcome.
-
Identify the selection behind the universal claim. Whenever someone says identity, history, or perspective should not matter, ask whether those factors are genuinely irrelevant or merely inconvenient.
-
Match scrutiny to consequence. Apply more skepticism to answers involving health, politics, money, rights, or representation than to low stakes recommendations.
-
Prefer accountable systems over supposedly impartial ones. A visible point of view can be evaluated. A hidden point of view can quietly govern you.
The deepest lesson is not that search engines are secretly advertisements or that artists must abandon imagination. It is that imagination and information both become dangerous when they deny the conditions that make them possible.
A machine that says, “Here is the answer,” may be selling you a hierarchy of relevance. A person who says, “I do not see color,” may be trying to reject prejudice, but can also overlook the social meaning carried by color in a particular history. In both cases, the issue is not merely intention. It is the structure through which intention becomes an outcome.
We should therefore stop asking whether a system is neutral as though neutrality were a stable substance it either possesses or lacks. Instead, ask: What does this system make easy to see, what does it make difficult to see, and who benefits from that arrangement?
That question changes the task from consuming answers to examining how answers are made. It turns the user into a reader, the audience into a critic, and the citizen into a participant. Most importantly, it reminds us that context is not decoration around reality. Very often, context is the part of reality that power most wants us to forget.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣