The Missing Ingredient in AI Is Not Intelligence. It Is Taste

Kazuki Nakayashiki

Hatched by Kazuki Nakayashiki

Sep 04, 2026

10 min read

93%

0

What if the most important question about artificial intelligence is not whether it can think like us, but whether it can help us care like us?

A system may pass a formal test of intelligence while failing a much older, more practical test: would you trust it to choose a book for someone you love? The distinction matters because human progress rarely comes from raw capability alone. It comes from capability directed by preference, context, memory, and relationships.

This is the overlooked connection between the future of AI and the humble social act of recommending a book. A powerful model can generate a thousand plausible answers. But a person who knows you can identify the one answer that will change your mind, comfort you, or reveal a part of yourself you had not noticed. The future will belong less to systems that merely produce more information than to systems that help people turn information into meaningful action.

Intelligence becomes useful only when it is placed inside a life.

The Difference Between Knowing and Helping

Modern AI is often described as if intelligence were a single vertical scale. At the bottom sit simple animals or basic programs. Higher up are ordinary humans, geniuses, and eventually machines that surpass us. This picture is attractive because it is easy to draw, but it confuses several different abilities.

A system can be excellent at recalling patterns and poor at handling novelty. It can write a convincing paragraph and fail at a simple unfamiliar puzzle. It can offer ten business strategies and have no idea which one fits your temperament, your obligations, or the moment you are living through.

Human intelligence is not one capability. It is a bundle of capacities that operate together: abstraction, memory, judgment, curiosity, emotional interpretation, practical improvisation, and the ability to decide what matters. The last of these is often ignored. Yet deciding what matters is what turns intelligence into agency.

Imagine two assistants. The first has read every book ever published and can summarize each one instantly. The second has read far fewer books, but remembers that you are grieving, that your sister has just started a company, and that you tend to reject advice when it feels too direct. Which assistant is more useful when you ask, “What should I read next?”

The first has more knowledge. The second has more situational intelligence.

This distinction helps explain why scaling information does not automatically scale judgment. More data can improve a system’s ability to answer questions. It does not, by itself, give the system a reason to prefer one answer over another. More language does not necessarily create more agency.

Oil offers a useful analogy. Oil is powerful because it amplifies human activity. It lets a vehicle carry people farther and faster, but it does not decide where they should go. The city, the suburb, the factory, and the logistics network are not contained inside the fuel. They are designed by people who imagine uses for the fuel.

AI may work the same way. It is not necessarily a new kind of person or a digital god. It may be a general purpose capability that amplifies whatever institutions, communities, and individuals know how to do with it. The crucial question then shifts from “How smart is the model?” to “What human system is this model entering?”

The Social Layer Is Where Meaning Appears

Consider how people actually discover important books. They rarely search a complete database, rank every possible title, and select the mathematically optimal result. They ask a friend. They notice what someone they admire is reading. They read a review written by a person whose taste they understand. They borrow a book because it mattered to someone specific.

This process is inefficient in the narrow computational sense, but it is rich in meaning. A friend’s recommendation contains more than a title. It carries a small model of the friend: what they notice, what they value, what they think you are ready to hear, and what they hope you will understand about them.

That is why reading someone else’s favorite book can feel intimate even when the reader is absent. The book becomes a bridge between two minds. It offers access not only to the subject of the book, but to the interior world of the person who chose it.

This social layer solves a problem that pure information systems cannot solve on their own: relevance is relational.

A recommendation is not simply a match between an object and a user. It is a judgment about the relationship between an object, a person, and a moment. The same book can be useless to you today, essential next year, and transformative after a particular conversation. Context is not a decorative layer added after intelligence. Context is what makes intelligence actionable.

This is also why many AI systems feel strangely impressive and strangely empty. They can produce answers that are fluent, broad, and technically informed. Yet they often fail to convey why this answer, for this person, now. They optimize for plausibility when people need significance.

A useful way to think about this is the three layer model of assistance:

  1. Capability: Can the system generate, retrieve, compare, or transform information?
  2. Context: Does it understand the user’s history, constraints, preferences, and current situation?
  3. Commitment: Is there a clear human reason for choosing this action over the alternatives?

Current AI is advancing rapidly on capability. It is improving on context as systems gain memory and access to personal data. Commitment remains the hardest layer because it involves values. A system can know what you have read without knowing what kind of person you are trying to become.

The danger is that we mistake layer one for the whole stack. If a machine can produce a persuasive answer, we assume it can make a wise recommendation. But eloquence is not commitment. Fluency is not care. A larger map does not tell you which road is worth taking.

Why Human Taste Becomes More Valuable as Machines Generate More

When content was scarce, the central problem was production. People needed more books, more images, more software, more explanations. As generative systems make production cheap, scarcity moves elsewhere.

The scarce resources become attention, trust, discernment, and the courage to choose.

This creates a paradox. The more answers machines generate, the more valuable a trusted human filter becomes. If a system can provide a hundred reading lists in seconds, the best reading list may be the one that begins with, “I know you usually avoid this genre, but you should read this because of what you told me last week.”

Human taste is not merely personal preference. At its best, taste is compressed experience. It is a record of encounters, disappointments, comparisons, and values. A good curator saves another person time, but more importantly, they lend them a temporary way of seeing.

This is why communities organized around shared judgment can become more powerful than communities organized around unlimited content. A social reading network, for example, does not need to know every possible fact about every book in order to be useful. It needs to help people find signals from the people whose signals they trust.

The same principle applies beyond books:

  • In education, students need more than explanations. They need mentors who can identify which explanation will unlock this particular student.
  • In medicine, patients need more than test results. They need interpretation that accounts for their history, fears, and tradeoffs.
  • In business, teams need more than strategic options. They need leaders who can decide which option fits the organization’s actual strengths.
  • In creative work, artists need more than generated possibilities. They need a sense of which possibility feels alive rather than merely polished.

AI increases the supply of possibilities. Human judgment determines which possibilities deserve a life.

This is the real meaning of the so called middle ground in AI. The desirable future is not one in which humans cling to every task out of nostalgia, nor one in which machines make every consequential decision because they appear more intelligent. It is a future in which machines handle scale, variation, and routine exploration while humans retain responsibility for direction, interpretation, and value.

The goal is not to preserve every human task. It is to preserve human authorship of what the tasks are for.

The New Interface: From Search Engines to Relationship Engines

The first generation of digital tools organized information. Search engines helped us find what existed. Social networks helped us see what people around us were discussing. Generative AI can produce what does not yet exist. The next important interface may combine all three functions around a person’s evolving goals.

Such a system would not simply ask, “What answer is correct?” It would ask questions like:

  • What have you already tried?
  • What kind of challenge are you ready for?
  • Which people’s judgment do you trust in this area?
  • What would change your mind?
  • What are you avoiding because it is difficult, rather than because it is irrelevant?

This is more than personalization. Personalization often means showing a user more of what they already like. Genuine assistance sometimes requires the opposite: introducing a carefully chosen disruption.

A friend who recommends only books that resemble your previous favorites is convenient. A friend who understands your taste well enough to recommend something unfamiliar is valuable. They can distinguish between novelty that expands you and novelty that merely wastes your time.

AI could help build this kind of discovery system, but only if it treats a person’s history as more than a set of clicks. Reading records, saved ideas, abandoned projects, conversations, and strong reactions can become a map of intellectual identity. The purpose of that map should not be to trap someone inside a predicted preference. It should be to reveal promising paths beyond the obvious ones.

That requires a different design principle: personal memory should expand agency, not narrow it.

A system that knows you love history should not endlessly recommend more familiar history. It might notice that you return to questions about power, belonging, and technological change, then introduce a novel, biography, or scientific essay that approaches those questions from an unfamiliar angle. The system becomes useful not by pretending to be your friend, but by helping you make better use of the relationships, values, and curiosities you already possess.

A Practical Discipline for Using AI Without Losing Yourself

The challenge for individuals is not to decide whether to use AI. It is to decide where to place it in the chain between possibility and action.

A simple framework is to divide work into four stages:

  1. Expansion: Ask AI to generate options, examples, questions, analogies, and alternatives.
  2. Interpretation: Compare those options against your lived context, goals, and constraints.
  3. Selection: Choose one direction and state why it deserves commitment.
  4. Reflection: After acting, record what happened and update your judgment.

AI is especially strong at expansion. It can help you escape the first idea and expose the shape of a problem. It can also assist with interpretation by showing tradeoffs you overlooked. But selection should remain visibly yours, particularly when the decision affects your relationships, reputation, work, or identity.

Try this with reading. Ask a model for twenty books on a topic, then ask it to classify them by difficulty, viewpoint, and emotional intensity. Next, consult a person whose taste you trust, or write your own explanation of what you are seeking. Choose one book and record the reason. Months later, revisit the choice. Did it change your thinking, or did it merely confirm what you already believed?

That small practice turns consumption into learning. It also prevents AI from becoming a vending machine for frictionless recommendations. The point is not to eliminate uncertainty. It is to make uncertainty more productive.

Key Takeaways

  • Separate capability from agency. A system that can produce many answers is not automatically able to choose the right answer for your situation.
  • Use AI for expansion, not surrender. Let it generate possibilities and challenge assumptions, but keep responsibility for important choices.
  • Treat taste as compressed experience. Your preferences, reading history, and trusted relationships are valuable sources of judgment, not obstacles to optimization.
  • Seek meaningful novelty. Ask for recommendations that stretch your perspective while still connecting to questions you genuinely care about.
  • Build a reflection loop. Track what you chose, why you chose it, and what happened afterward. Judgment improves through feedback, not through information alone.

The deepest question about AI is therefore not whether machines will become more like humans. It is whether humans will become more deliberate about what only humans can supply: purpose, attachment, interpretation, and commitment.

A machine may eventually know every book. It may understand every genre, predict every preference, and write a flawless review. But the most important recommendation will still contain a human mystery: why this, for you, at this moment?

That mystery is not a defect to be engineered away. It is the space where a life becomes a life rather than a sequence of optimized outputs. The future will be shaped by powerful systems, but its meaning will depend on the people who teach those systems what is worth doing.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣