The Real Test of AI Is Not What It Gives Us, but What We Give Back

Kazuki Nakayashiki

Hatched by Kazuki Nakayashiki

Aug 19, 2026

12 min read

94%

0

What if the most important question about artificial intelligence is not whether it can make us more productive, but whether it changes our relationship with the people who made our lives possible?

A striking pattern is emerging in how people actually use AI. Most commonly, they use it to find information. Younger adults are especially likely to use it for generating ideas. Far fewer use it for work, despite years of promises about revolutionary productivity. And a meaningful minority already turns to AI for companionship.

These uses may look unrelated. Searching for information seems practical. Brainstorming seems creative. Companionship seems emotional. But together they reveal a single movement: people are gradually moving parts of their intellectual and social lives into a system that can respond instantly, endlessly, and without asking much in return.

That convenience creates a question deeper than the familiar debate about whether AI is good or bad. What happens when a technology becomes not merely a tool we use, but an environment in which we think, decide, create, and seek comfort?

The answer depends on whether AI becomes a substitute for human contribution or a way of extending it. The difference is not technical. It is moral and cultural.

The First Migration: From Using Tools to Consulting Systems

A calculator performs an operation. A search engine retrieves documents. A pencil records an idea. These tools are powerful, but they remain visibly limited. We know where their contribution ends and ours begins.

Conversational AI is different because it presents itself as a participant. It can answer a question, propose a plan, rewrite a paragraph, generate an image, or simulate a conversation. Its flexibility makes it feel less like an instrument and more like a general purpose intellectual environment.

The polling pattern matters because it shows where this migration begins. People are not first handing over their entire professional lives. They are asking for information, suggestions, phrasing, and small acts of assistance. These are the low friction parts of thought, the moments when we feel stuck, curious, rushed, or alone.

Imagine a person trying to understand a confusing medical term. They could search several websites, compare explanations, and decide which sources to trust. Instead, they ask an AI system for a plain language explanation. Or imagine a student staring at a blank page. Rather than waiting through the discomfort of uncertainty, the student asks for ten possible directions. Or imagine someone living alone who wants to talk late at night. A conversational system is always available.

None of these actions is automatically harmful. In many cases, they are genuinely useful. The important point is that they all reduce a particular kind of friction: the friction of not knowing, not knowing what to say, not knowing where to begin, or not having anyone available.

Friction is often treated as a defect in human life. Sometimes it is. But some forms of friction are where judgment, originality, and relationship are formed. The pause before an answer can be the beginning of reflection. The struggle to formulate an idea can reveal what one actually believes. The effort to find a person to talk with can deepen a relationship.

AI does not merely remove these obstacles. It changes which obstacles we encounter, and therefore which capacities we practice.

The convenience of an answer can conceal the disappearance of a question.

This is why the rise of AI companionship deserves to be considered alongside AI information and AI creativity. All three represent a movement toward outsourced presence. We are not just outsourcing tasks. We are outsourcing the occasions that once forced us to exercise attention, imagination, and mutual dependence.

The Human Fact Hidden Inside Every Intelligent Machine

There is a sentence that can serve as a corrective to technological self importance:

I love and admire my species, living and dead, and am totally dependent on them for my life and well being.

At first, this sounds like a statement about gratitude. It is more radical than that. It describes human life as fundamentally derivative. Everything we call personal ability rests on an enormous inheritance of language, knowledge, infrastructure, care, examples, institutions, and labor supplied by other people.

Even the most original idea is made from materials one did not invent. The words used to express it came from a community. The concepts behind it were shaped by teachers, predecessors, critics, and collaborators. The electricity that powers a computer, the roads that deliver it, the data centers that host it, and the legal systems that organize its use all depend on collective effort.

Artificial intelligence can make this dependence harder to see. Its interface is singular and intimate. We type a request into a box and receive a response. The many human contributions behind that response disappear into the smoothness of the interaction.

This creates a paradox. AI can reveal how much knowledge humanity has accumulated, while simultaneously making that knowledge feel as if it came from nowhere. It can give us access to the work of countless people, while encouraging the illusion that we need no people at all.

That illusion is dangerous because dependence is not a weakness to be eliminated. Healthy dependence is the basis of civilization. A child becomes capable through dependence on caregivers and teachers. A scientist advances through dependence on prior research. A writer develops through dependence on readers, editors, and a living language. A society becomes resilient when its members can rely on one another without treating reliance as failure.

The question is therefore not whether AI makes us dependent. We are already dependent, and always will be. The question is whether it directs our dependence toward a richer human world or toward a narrower loop of consumption.

A person who uses AI to understand a difficult subject may become more capable of contributing to a conversation. A person who uses it to generate possibilities may discover a direction worth pursuing. A person who uses it to draft a message may communicate more thoughtfully. In these cases, AI acts as a bridge back into human participation.

But if the system becomes the final destination, the pattern changes. The student no longer learns enough to discuss the subject. The creator no longer develops a point of view. The lonely person no longer risks the vulnerability of contacting another human being. The tool has not simply helped. It has absorbed the very activity that would have connected the user to others.

The Reciprocity Test

A useful way to evaluate any use of AI is to ask a question that productivity metrics rarely capture: Does this use increase or decrease my capacity to give something back?

Call this the reciprocity test.

If AI helps someone learn a skill, the person can later teach, explain, build, or contribute. If it helps a team examine more possibilities, the team may make a better decision and serve others more effectively. If it helps a writer revise a confusing argument, the final work may give readers a clearer insight.

In each case, the value of assistance flows outward. The user receives something and transforms it into a contribution.

Now consider the opposite pattern. A person asks AI to produce an opinion without developing one, to imitate expertise without acquiring understanding, or to provide companionship without practicing care. The system may satisfy an immediate need, but the exchange ends at consumption. Nothing returns to the social world except a weaker version of the user’s own capacity.

This distinction is more useful than dividing AI into good and bad applications. The same tool can support either pattern. A language model can help a student understand an argument or allow the student to avoid reading it. It can help an employee prepare for a difficult conversation or encourage them to send an emotionally vacant message. It can help a lonely person rehearse how to reach out or become a perfectly responsive replacement for reaching out.

The technology does not determine the moral direction by itself. The direction is set by what the user does after receiving assistance.

A simple model is helpful:

  1. Receive: Use AI to obtain information, possibilities, structure, or feedback.
  2. Digest: Check, question, adapt, and connect the output to lived experience.
  3. Contribute: Turn the improved understanding into a decision, creation, relationship, or act of service.
  4. Reenter: Bring the result back into the human world, where it can be tested and shared.

The failure mode is stopping after the first step. The user receives an answer but never digests it, contributes with it, or reenters the world. AI then becomes an endpoint rather than an amplifier.

This is especially important for younger people, who appear more likely to use AI for generating ideas. Their frequent use is not necessarily evidence of laziness or decline. It may reflect a new kind of creative apprenticeship. But apprenticeship requires eventual independence and contribution. A musician who studies scales must eventually play music. A thinker who gathers possibilities must eventually choose, risk, and speak in their own voice.

The goal is not to preserve struggle for its own sake. It is to preserve the developmental sequence through which assistance becomes ability.

Why Companionship Changes the Stakes

Information and creativity can often be evaluated by examining their outputs. Companionship is different because its value lies in the relationship itself.

Human companionship is costly. It requires availability, patience, interpretation, forgiveness, and the willingness to be changed by another person. A friend is not merely a responsive interface. A friend has needs, boundaries, memories, and a perspective that cannot be fully controlled. That resistance is part of the value.

An AI companion can offer something real: a prompt for reflection, a rehearsal space, a sense of being heard, or temporary relief from isolation. For someone who has no one to contact at a particular moment, that relief may matter enormously. It would be careless to dismiss such benefits.

But companionship also trains us in what to expect from relationship. If we become accustomed to a partner that never becomes tired, never disagrees unpredictably, never asks us to accommodate its needs, and is always optimized for our emotional preferences, human relationships may begin to feel defective by comparison.

The danger is not that people will mistake a machine for a human in some simple way. The deeper danger is that they will learn to prefer relationships without reciprocity.

This returns us to the idea of dependence. Human beings need one another not only because others provide useful services, but because other people make claims on us. Their vulnerability summons responsibility. Their differences challenge our assumptions. Their disappointment can expose the gap between our intentions and our behavior.

A system that offers comfort without requiring care can be beneficial in moments, but it cannot by itself teach mutuality. It may soothe loneliness while leaving the user less practiced in the difficult art of being a person among persons.

The measure of a comforting technology is not only whether it makes us feel less alone, but whether it helps us become more capable of showing up for someone else.

That standard does not require rejecting artificial companionship. It requires placing it inside a larger ecology of human contact. Use it to prepare for a conversation, clarify a feeling, or find the courage to ask for help. Do not let it become the only relationship in which you are never required to give.

Designing AI Use Around Human Return

The practical challenge is to build habits that ensure AI sends us back into the world with greater capacity. This can begin with small rules.

Before asking AI for an answer, ask what kind of help is needed. Is the goal to learn, to decide, to create, or merely to avoid discomfort? The same prompt can serve different purposes, and naming the purpose makes it easier to notice when assistance has become avoidance.

After receiving an output, perform one act of ownership. Rewrite the central idea in your own words. Verify an important claim. Add a personal example. Explain the result to someone else. Ownership converts a fluent response into understanding.

For creative work, preserve a period of unassisted generation. Write the first paragraph, sketch the first concept, or list the first five possibilities before consulting a system. This keeps AI from becoming the source of all beginnings, because beginnings are where taste and direction are formed.

For relationships, use AI as a rehearsal room, not a final address. If a conversation matters, let the system help you clarify what you want to say, then say it to the person. If you feel lonely, use the interaction to identify the kind of human contact you need, then take one concrete step toward it.

At the organizational level, leaders should measure more than time saved. They should ask whether employees understand more, make better judgments, and develop skills that remain when the system is unavailable. A workplace that produces faster but less capable people has not achieved lasting productivity. It has consumed its own human capital.

Key Takeaways

  • Use the reciprocity test: After AI helps you, ask what you can now contribute that you could not contribute before.
  • Do not confuse fluency with understanding: Verify important claims, restate ideas in your own words, and connect outputs to experience.
  • Protect the beginning of creative work: Spend some time forming your own questions and possibilities before asking AI to generate them.
  • Treat companionship as a bridge: Let AI help you reflect or prepare, but use that clarity to reenter human relationships.
  • Measure capability, not just convenience: The best use of AI leaves you more able to think, decide, create, and care without it.

The future of AI will not be decided only by model quality, adoption rates, or the number of tasks automated. It will also be decided by the habits people form around assistance.

We can use these systems to become passive consumers of an intelligence we did not create, receiving answers from an invisible human inheritance while returning little to the world. Or we can use them as instruments of participation, drawing on the accumulated work of our species and transforming it into new acts of understanding, invention, and care.

The crucial distinction is not between machine intelligence and human intelligence. It is between intelligence that closes the loop and intelligence that opens one.

Every useful answer should lead somewhere: to a better question, a braver decision, a clearer piece of work, or a more generous encounter. If it does not, the convenience may be costing more than time.

We are totally dependent on one another for our lives and well being. Artificial intelligence will not change that fact. It will test whether we can remember it while using a technology designed to make dependence feel invisible.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣