The Best AI Experiences Feel Like Great Music
Hatched by Thomas Hirschmann
Sep 05, 2026
10 min read
0 views
92%
What if the most important question in artificial intelligence is not how much it knows, but how well it manages surprise?
A system that is always predictable becomes dull. A system that is always surprising becomes confusing. The experiences that hold our attention, teach us, and change our behavior occupy a narrower territory: they give us enough structure to form expectations, then violate those expectations just enough to make learning feel rewarding.
This principle explains something important about both the human brain and the future of AI. The same tension that makes a piece of music compelling can determine whether an AI assistant helps us think or merely trains us to consume answers. It can shape whether innovation produces genuine capability or just novelty. It can even help explain why responsible AI cannot be solved by technical brilliance in one country or one company alone.
The deeper challenge is this: how do we design systems that surprise us without making us lose our bearings?
The brain is not addicted to reward. It is addicted to improving its predictions
Dopamine is often described as the brain's pleasure chemical, but that description is too simple to be useful. Its more interesting role is connected to seeking, evaluation, and learning. The brain is continually making forecasts about what will happen next, then comparing those forecasts with reality.
When reality is better than expected, dopamine activity tends to increase. When the result is worse than expected, activity decreases. The crucial event is not merely receiving a reward. It is receiving information that changes the quality of the brain's model of the world.
Consider listening to a song for the first time. You hear a rhythm, a melody, and a repeated phrase. Your mind begins to anticipate what comes next. If the next passage follows the pattern perfectly, you experience coherence. If it departs radically from the pattern, you may experience noise. But if it bends the pattern in a way that becomes intelligible a moment later, the result can feel thrilling.
That is why memorable music combines predictability and unpredictability. Familiar structures give the listener a foothold. Novel variations create a reason to keep listening. With repeated exposure, the listener learns the structure more deeply, which makes increasingly subtle departures possible.
This gives us a useful model for understanding innovation:
Attention is captured by surprise, but understanding is built by structured surprise.
The distinction matters because modern technology is exceptionally good at producing novelty. It can generate an endless stream of new images, explanations, recommendations, and conversational turns. But novelty alone does not guarantee learning. A slot machine also produces surprise. It does not necessarily produce wisdom.
An effective AI system should therefore be judged not only by whether it can produce an unexpected answer, but by whether its unexpectedness improves the user's internal model. Did the person notice a hidden assumption? Discover a better explanation? See a connection that can be reused later? Or did the system simply create another momentary burst of stimulation?
The first kind of surprise compounds. The second kind evaporates.
Generative AI is an expectation machine, for better and worse
Large language models are powerful partly because they operate within the same basic ecology of expectation. Given a prompt, the user anticipates a certain kind of response. The model then completes, reframes, extends, or sometimes disrupts that expectation.
A useful answer usually has a recognizable shape. It addresses the question, uses relevant concepts, and follows enough familiar conventions to remain legible. Yet the answer becomes valuable when it contributes something the user did not already have: a sharper distinction, an overlooked example, a new framework, or an implication that follows from the question but was not obvious before.
This is the conversational equivalent of a well composed melody. The system establishes a pattern, then earns the right to depart from it.
Poor AI experiences fail in two opposite ways. The first is predictable fluency. The response sounds polished but says little that could not have been generated from the user's initial assumptions. It creates the feeling of progress without changing the user's map of the problem. The second is unbounded novelty. The response offers obscure analogies, unsupported claims, and constant reframing. It may sound creative, but it imposes too much cognitive work on the user.
The practical design target lies between them. We might call it the surprise bandwidth of a system: the amount of novelty a person can absorb while preserving a sense of orientation.
Surprise bandwidth varies by context. A beginner learning statistics needs more scaffolding and smaller departures from familiar examples. An expert may need the opposite: a challenge that reveals where expertise has become habitual. A medical diagnostic tool should be conservative when a mistake could harm someone. A brainstorming assistant can take larger creative risks, provided it clearly distinguishes speculation from established knowledge.
This suggests that AI should not have one universal style of helpfulness. It should adapt its level of surprise to three variables:
- The user's current model: What does the person already understand?
- The cost of error: What happens if an unexpected suggestion is wrong?
- The value of exploration: How much could be gained by leaving the familiar path?
A writing assistant helping with a birthday message can introduce unusual imagery freely. An AI supporting an engineer, lawyer, or physician must make its departures inspectable. In high consequence settings, surprise should arrive with an explanation of its basis, its uncertainty, and the assumptions that produced it.
The goal is not to make AI less creative. It is to make creativity legible.
The danger of confusing stimulation with innovation
There is a political and economic temptation to equate rapid novelty with progress. New models appear, new applications are announced, and new capabilities generate a stream of attention. But a system can be innovative in the narrow sense while making the surrounding culture less capable of thinking.
The dopamine dynamics of expectation help clarify why. If every interaction is optimized for immediate engagement, systems may learn to maximize positive prediction error in the shortest possible cycle. They can become experts at producing the next surprising thing, regardless of whether that thing contributes to durable understanding.
Imagine an AI news service that continually presents startling headlines. Each item is crafted to exceed the user's expectations. After an hour, the user has experienced dozens of informational jolts but cannot explain any underlying trend. The system has optimized arousal, not comprehension.
Now imagine a different service. It begins with a familiar event, identifies the user's likely assumptions, and then introduces one carefully chosen contradiction. It shows a pattern across several examples. It asks the user to make a prediction before revealing the outcome. Over time, the user becomes better at recognizing the structure without the service.
The second system may feel less exciting moment to moment. Yet it is more genuinely innovative because it transfers capability to the person using it.
This gives us a distinction that deserves wider use:
- Stimulation produces repeated dependence on the system for the next surprise.
- Learning produces increasing independence from the system because the user can now predict more effectively.
A beneficial AI should sometimes leave the user able to do something without it. That outcome can look like reduced engagement in the narrow metrics of clicks, minutes, or requests. But it represents a deeper success: the system has expanded the user's competence rather than merely occupying attention.
The distinction also changes how we should evaluate innovation. Instead of asking only, “How impressive is the output?” we should ask:
- What expectation did the system challenge?
- What new model did the user acquire?
- Can the user apply that model in a different situation?
- Did the interaction increase judgment, or only increase appetite for another interaction?
These questions move us from spectacle to capability. They also make clear why responsible deployment cannot be reduced to adding warnings after a system is built. Responsibility is partly a question of interaction design: what kinds of expectations does the system cultivate, and what kinds of behavior does it reward?
Why responsible AI requires more than one cultural viewpoint
A system that manages surprise well must understand context. What counts as an illuminating departure in one community may appear incoherent, offensive, or dangerous in another. Expectations are not formed by the brain alone. They are shaped by language, institutions, history, professional norms, and collective memory.
This is one reason international cooperation matters. The problem is not simply that different countries may regulate technology differently. It is that different societies may notice different failure modes and imagine different forms of benefit.
One culture may emphasize individual autonomy and consumer choice. Another may focus more heavily on social trust, public infrastructure, or the duties of institutions. One may be quick to celebrate disruption. Another may be more alert to the ways disruption can weaken relationships and shared norms. These are not obstacles to be flattened into a single global template. They are sources of diagnostic diversity.
The analogy to music is useful again. A shared musical structure can support many local variations. Harmony does not require every instrument to play the same note. In the same way, international coordination need not mean uniformity. It can mean agreement on basic principles while preserving different experiments in education, public services, labor, and creative practice.
The basic principles might include:
- People should be able to understand when an AI is uncertain or making a speculative leap.
- High consequence decisions should remain contestable and reviewable.
- Systems should be tested across languages, cultures, and social contexts.
- Innovation should be measured by durable human capability, not only by adoption or engagement.
- The benefits and risks of advanced AI should be examined collectively because neither technical systems nor their consequences stop at national borders.
International cooperation is therefore not just a diplomatic ideal. It is a way of increasing the resolution of our collective prediction system. Different perspectives allow societies to detect surprises that a single perspective would treat as normal.
A practical framework: the four moves of beneficial surprise
The connection between dopamine, music, and AI can be turned into a practical method for using intelligent systems well. Before accepting an AI output, move through four stages.
1. Establish the pattern
Ask what you already expect. What is the conventional answer? What assumptions are built into the question? If you cannot state the baseline, you may not be able to recognize whether the system has produced insight or mere novelty.
For example, before asking an AI for ways to improve a meeting, identify the default assumption: perhaps that meetings fail because they are too long. That creates a reference point for evaluating more interesting possibilities.
2. Invite a bounded departure
Ask the system to challenge one assumption, not all of them at once. Prompts such as “What is the strongest alternative explanation?” or “Which part of this plan would an expert disagree with?” create useful tension without dissolving the whole problem.
Bounded departure is more productive than a vague request for creativity because it gives surprise a role. The aim is not to be different. The aim is to expose a possibility that matters.
3. Demand the bridge back
When an answer is surprising, ask why it follows. What evidence supports it? Which assumption did it change? What would have to be true for the recommendation to work?
This step converts a dopamine event into learning. It links the new idea to a structure the user can inspect and remember.
4. Test transfer
Finally, use the idea somewhere else. Can the insight apply to a different example, domain, or decision? If not, it may have been entertaining but not generative.
A useful AI interaction should leave behind a reusable question, distinction, or procedure. The real product is not the answer on the screen. It is the improved prediction the user carries into the next situation.
Key Takeaways
- Seek structured surprise, not constant novelty. Start with a clear baseline, then ask for one meaningful challenge to it.
- Use AI to improve your predictions. Before accepting an answer, ask what expectation it changes and what new model it provides.
- Match surprise to stakes. Encourage bold exploration in creative work, but require evidence, uncertainty, and review in high consequence domains.
- Measure learning by transfer. An interaction has lasting value when you can apply its insight without returning to the system immediately.
- Treat cultural diversity as a safety instrument. Different communities reveal different assumptions and different risks, making cooperation a source of intelligence rather than merely a constraint.
The future of AI will not be decided only by whether machines can generate more surprising outputs. It will be decided by whether those outputs help human beings become better at anticipating, interpreting, and choosing.
Great music does not eliminate expectation. It teaches us to hear more finely. In the same way, great AI should not overwhelm us with novelty or soothe us with familiar answers. It should give us a stable enough pattern to understand, a precise enough disruption to learn from, and enough independence to continue without it.
That may be the most important test of beneficial intelligence: after the surprise fades, are we merely waiting for the next one, or do we now see the world differently?
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣