The Wrong Metric Can Make You Healthier on Paper and Worse in Reality
Hatched by Manoj Nayak
Aug 10, 2026
10 min read
0 views
94%
What if the reason we keep failing at health, growth, and behavior change is not that we lack data, but that we keep optimizing the wrong thing?
A company can spend millions lowering its cost per acquisition while attracting customers who never stay. A person can cut fat, count calories, and choose products labeled healthy while consuming more sugar and becoming hungrier. In both cases, the mistake looks rational from inside the system. The numbers improve. The dashboard turns green. Yet the underlying outcome gets worse.
This is the deeper problem: optimization is only intelligent when the objective is intelligent.
The history of obesity and the practice of customer acquisition appear to belong to different worlds. One concerns metabolism, appetite, and public health. The other concerns channels, experiments, and business growth. But together they reveal a powerful general principle: when a complex system is judged by a convenient proxy, people gradually redesign the system around the proxy, even when the proxy has stopped representing what they actually want.
The danger of winning the wrong game
In the 1960s, concern about heart disease encouraged a focus on dietary fat. Fat is calorie dense, so reducing fat appeared to be a straightforward way to reduce total calories. The intervention had an elegant logic: remove the most energy dense ingredient, and health should improve.
But food is not a spreadsheet. When fat was removed from many products, sugar and refined carbohydrates often took its place. The product could now satisfy a nutritional rule while becoming easier to overconsume. A low fat dessert still had the psychological status of a healthy choice, even if its composition made hunger and satiety behave differently.
The problem was not simply that one ingredient was misunderstood. It was that a proxy became the target. Lower fat was treated as equivalent to better health. Calories were treated as equivalent to metabolic effect. A visible label became a substitute for understanding the full system.
Business growth has its own version of this trap. A marketing team may optimize cost per acquisition because it is easy to measure. Another team may optimize reach, impressions, or initial signups. These metrics can be useful, but none is identical to the business outcome. A cheap customer who churns in a week is not cheap. A large audience with no meaningful engagement is not traction. A channel that generates immediate conversions but teaches the company nothing may be less valuable than a smaller channel that clarifies who the product is for.
The shared error is subtle: a measurement that begins as a tool becomes an objective, and the objective then reshapes behavior.
The question is not “Did the number improve?” It is “What does this number cause us to do, and does that behavior move us toward the outcome we actually value?”
Complex systems punish single variable thinking
Human appetite and customer acquisition have another feature in common: both are adaptive systems. Change one input and other parts of the system respond.
If a person removes fat from a meal, taste may decline. The manufacturer compensates with sugar, flavoring, or larger portions. If the resulting food is less satiating, the person may eat again sooner. The original intervention, considered in isolation, looks beneficial. Considered as a chain of responses, it may have the opposite effect.
A marketing channel behaves similarly. Suppose a company finds a way to acquire users at a very low cost. The company increases spending. The channel reaches a broader and less relevant audience. Conversion quality falls. Customer support costs rise. Retention declines. The original metric still looks attractive for a while because the acquisition report does not include the downstream effects.
This suggests a useful mental model: the substitution and feedback test. Whenever you optimize one variable, ask three questions:
- What will replace the thing being reduced?
- How will people or institutions adapt to the change?
- Which important costs or benefits occur later, outside the measurement window?
These questions expose why simple advice often fails. “Eat less fat” ignores what replaces the fat. “Acquire users more cheaply” ignores what cheap acquisition may do to user quality. “Maximize volume” ignores whether the organization can serve, retain, and learn from that volume.
The most dangerous interventions are not obviously foolish. They are locally correct and globally misguided. They improve a narrow measure while damaging the broader system that measure was supposed to describe.
The missing step is choosing what to learn
A disciplined acquisition process begins with a question that many teams skip: What are we optimizing for, and why? The answer might be learning, volume, cost, or some combination over time. The important point is that these goals are not interchangeable.
Early in a product’s life, learning may be more valuable than scale. A small, targeted channel can reveal which customers care, what language resonates, and where the product fails. A large channel may produce impressive volume while obscuring those answers. Later, when the product is reliable and the audience is understood, scale may become the rational priority.
This distinction offers a direct lesson for health decisions. The goal of a dietary experiment should not automatically be weight loss over the shortest possible period. It might be learning which meals produce stable energy, which foods reduce cravings, or which routine is sustainable under ordinary working conditions. Weight can matter, but treating it as the only immediate objective encourages short term tactics that may be impossible to maintain.
In both domains, the sequence matters:
- Define the real outcome. What does success look like beyond the convenient metric?
- State the current uncertainty. What do you not yet know?
- Choose an intervention that teaches you something. Do not merely choose the intervention that produces the most dramatic short term result.
- Measure downstream effects. Include retention, sustainability, side effects, and adaptation.
- Update the model. Treat the result as evidence, not as a verdict on your character or intelligence.
Imagine two people trying to improve their diets. The first adopts an extreme restriction, loses weight quickly, becomes preoccupied with food, and returns to old habits six weeks later. The second changes breakfast, tracks afternoon hunger, and discovers that a meal with more protein and less added sugar prevents the daily vending machine visit. The first may win the initial metric. The second has acquired a reusable piece of knowledge.
The same contrast appears in growth. One startup buys broad traffic and celebrates a low initial acquisition cost. Another runs a small campaign aimed at a precisely defined audience, then interviews new users and studies retention. The first buys numbers. The second buys information. At an early stage, information may be the scarce resource that makes future growth possible.
Build a matrix for reality, not certainty
When comparing acquisition channels, a simple matrix can prevent intuition from dominating the decision. Each channel is evaluated across attributes such as targeting, cost, time to launch, time to results, control, and scale. The values need not be exact. Low, medium, and high are often enough to make hidden tradeoffs visible.
The same structure can improve personal health decisions. Instead of asking whether a diet is good in the abstract, evaluate a proposed change across several dimensions:
| Dimension | Question |
|---|---|
| Satiety | Does it reduce hunger for several hours? |
| Energy | Does it support stable concentration and mood? |
| Simplicity | Can it be repeated on a busy day? |
| Feedback speed | How quickly can you tell whether it helps? |
| Control | Can you adjust one variable without changing everything? |
| Sustainability | Can you imagine doing it for six months? |
| Social fit | Does it survive restaurants, travel, and family life? |
This is not an argument for turning eating into a laboratory. It is an argument for making tradeoffs explicit. A plan that looks excellent on calorie reduction but poor on hunger, simplicity, and sustainability is not necessarily an excellent plan. It may simply be optimized for the easiest column to measure.
The matrix also reveals why universal prescriptions are unreliable. A channel with high scale and low control may be right for an established company but wrong for a startup that needs to learn. A dietary intervention with fast weight loss may be useful in a clinical context but inappropriate as a general lifestyle recommendation if it produces severe hunger or cannot survive ordinary life.
Constraints determine the best experiment. A company constrained by money should prefer channels that provide information cheaply. A person constrained by time should prioritize changes with low preparation demands. Someone constrained by medical conditions needs a different set of options entirely. There is no best strategy independent of the constraint.
The practical discipline of small, reversible experiments
When the causes of an outcome are uncertain, confidence should decrease as the intervention becomes larger and less reversible. Yet organizations and individuals often do the opposite. They make sweeping changes based on weak evidence, then interpret the result as proof of a grand theory.
A better approach is to run small, controlled, reversible experiments.
For a business, this might mean testing one or two channels rather than spreading resources across every possible source of traffic. The team sets a specific learning goal, defines a reasonable budget, chooses a meaningful observation period, and decides in advance what evidence would justify continuing.
For personal health, it might mean changing one meal pattern for two weeks while tracking hunger, energy, sleep, and adherence. If everything changes simultaneously, the result is difficult to interpret. If one variable changes, the person can learn whether the intervention helped and why.
The key is not obsessive measurement. It is causal humility. A result can tell you that something happened without telling you exactly why. Weight may change because of water, appetite, activity, sleep, medication, or a mixture of factors. A campaign may convert because of brand familiarity, seasonal demand, audience quality, or an accidental creative effect.
This is why the most useful experiments are designed around decisions, not vanity. Before starting, ask:
- What decision will this experiment help me make?
- What result would count as encouraging?
- What result would tell me to stop?
- What unintended effect would make the apparent success unacceptable?
- What will I do differently if the hypothesis is wrong?
A failed experiment that answers an important question is often a success in disguise. A successful experiment that teaches nothing and creates hidden liabilities may be failure with flattering statistics.
Key Takeaways
-
Name the true objective before choosing the metric. Decide whether the immediate priority is learning, volume, cost, health, energy, or sustainability. Never assume the easiest number is the most important one.
-
Test what replaces what you remove. Cutting fat may increase sugar. Cutting acquisition cost may reduce customer quality. Every reduction creates a substitution that deserves attention.
-
Use a matrix to expose tradeoffs. Compare interventions across targeting, cost, speed, control, scale, sustainability, and downstream effects. Qualitative ratings are often more useful than fake precision.
-
Run one or two small experiments. Change enough to learn, but not so much that you cannot identify the cause or reverse the decision.
-
Measure the whole journey. Include retention after acquisition and hunger, energy, and adherence after dietary change. A short term improvement is only valuable if it survives contact with the future.
The deepest lesson is not that fat is good, sugar is bad, or one marketing channel beats another. Those claims are too simple for adaptive systems. The deeper lesson is that the structure of a decision often matters more than the certainty of the advice.
A society can be highly sophisticated at measurement and still be foolish at optimization. It can produce better dashboards, more labels, cheaper traffic, and more precise targets while drifting further from the outcomes it cares about. The cure is not to abandon metrics. It is to place metrics back in their proper role: instruments for learning about reality, not substitutes for reality itself.
The next time a number improves, pause before celebrating. Ask what behavior produced the improvement, what was pushed out of view, and what the system will do next. That question may be the difference between making progress and merely becoming more efficient at going in the wrong direction.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣