When the System Gets Smarter, the Margin for Fragility Shrinks

Emil Funk Vangsgaard

Hatched by Emil Funk Vangsgaard

Jul 14, 2026

9 min read

74%

0

The hidden cost of “efficiency” is usually fragility

What do an older adult with dementia and a generative AI model have in common? At first glance, almost nothing. One is a human body navigating frailty, the other is a digital system consuming electricity at scale. But both expose the same uncomfortable truth: as systems become more capable, their failure modes become more consequential.

A fall in an older adult with cognitive impairment is not just a stumble. It can become a turning point that leads to lost confidence, social isolation, declining physical health, institutionalization, and even death. Likewise, a powerful AI system is not just a more advanced tool. It can quietly become an energy multiplier, placing pressure on already strained grids and expanding the physical footprint of digital convenience. In both cases, the apparent gain in capability hides a rise in systemic vulnerability.

This is the real tension: progress often looks like efficiency at the center and fragility at the edges. We celebrate smarter systems because they do more, faster, and with less obvious effort. Yet the more a system depends on brittle thresholds, the more dangerous its failures become. The question is not whether we should make systems smarter. It is whether we understand what smartness costs when the margin for error gets smaller.


Why the most important risks are not the most obvious ones

The instinct is to look for simple causal explanations. If a person falls repeatedly, we assume comorbid health conditions must be the main driver. If AI demand rises, we assume the issue is simply more computation. But the deeper pattern is more unsettling: some risks are governed less by accumulated conditions than by exposure to a tipping point.

That is why the presence of comorbid conditions in an older adult with dementia may not neatly predict recurrent injurious falls. The body is not a checklist of independent liabilities. It is a dynamic system where balance, attention, gait, environment, and confidence interact. A person can have several conditions and remain stable, then one small event, a slippery floor, a rushed turn, a moment of confusion, produces a cascade.

The same logic applies to AI and energy. The individual energy footprint of a single model call may look modest. But once adoption scales, the relevant unit is no longer one query. It is the entire stack: training, inference, data centers, cooling, grid load, and infrastructure expansion. What matters is not just direct use, but compounding demand under scale.

The most dangerous systems are often the ones that seem manageable at the level of one event, one user, or one moment.

This is where many organizations get the diagnosis wrong. They look for static risk factors and miss dynamic thresholds. They search for the “cause” of failure in the background conditions, when the true issue is often the system’s reduced ability to absorb shocks.


A useful mental model: the three layers of resilience

To connect these domains, it helps to think in terms of three layers of resilience.

1. Baseline capacity

This is the underlying strength of the system. For a person, it includes mobility, cognition, vision, muscle strength, and general health. For AI, it includes architecture efficiency, model optimization, and infrastructure design.

2. Shock absorption

This is the ability to handle disruptions without crossing a critical threshold. For older adults, that means recovering balance, using support, avoiding dangerous environments, and retaining confidence after a near fall. For AI systems, it means handling spikes in demand without overloading data centers or destabilizing the grid.

3. Recovery cost

This is what happens after the failure. A fall can lead to hospitalizations, loss of independence, and long term decline. An energy hungry AI deployment can increase emissions, force expensive infrastructure investment, and lock organizations into unsustainable operating patterns.

The crucial insight is that resilience is not just about avoiding collapse. It is about reducing the cost of collapse when it does occur. Many systems are optimized for normal conditions and underprepared for failure conditions. That is why a fall and a power surge can each become more than a discrete incident. They can become a new baseline.

Here is the shared lesson: when you increase dependency on a system, you must also increase its capacity to fail safely.


The trap of invisible accumulation

There is another similarity between recurrent falls and AI energy demand: both involve invisible accumulation.

A fall risk does not announce itself loudly. It builds through small changes, a little less stability, a little more hesitation, a slightly cluttered home, a small decline in reaction time. The person may appear fine until the threshold is crossed. Then the consequences are dramatic, because the event is visible only at the end, not during the accumulation.

AI energy consumption follows a similar pattern. One prompt does not strain a grid. One model does not transform global emissions. But adoption curves are deceptive. The energy cost is often hidden inside conveniences that users barely notice. Each interaction feels weightless, while the infrastructure behind it grows heavier.

This is why both domains punish complacency. People often manage what they can see. But the dangerous part is what stays just below awareness until it has already scaled.

A helpful analogy is a bridge. A single car does not matter. A bridge is designed for load. But if traffic grows, and if weight concentrates in unexpected ways, the bridge can still fail. The failure is not caused by one car. It is caused by a mismatch between assumed capacity and actual stress. That is the situation with both frailty and AI infrastructure: the stress is cumulative, but the consequences are sudden.


Confidence is a form of infrastructure

One of the most overlooked effects of a fall is not physical injury but loss of confidence. A person who falls may begin to move differently, avoid activity, or limit participation. That reduction in movement can accelerate decline. In other words, the event does not merely injure the body. It changes behavior, and behavior then changes future risk.

This is a powerful framework for thinking beyond medicine. Confidence is not soft. It is a kind of infrastructure. It shapes what a system dares to do.

The same is true in technology. If AI systems become so resource intensive that organizations hesitate to deploy them, innovation may slow. If energy costs become unpredictable, teams begin to constrain experimentation. If grids become strained, policy and public trust may shift. The technical system creates its own behavioral feedback loop.

This suggests a deeper principle: failure changes the system that experienced it. A fall can make a person less active, which increases future fall risk. A power intensive AI rollout can make an organization more dependent on expensive infrastructure, which makes future scaling harder. In both cases, the first failure is only the beginning of the story.

The best systems, then, are not merely powerful. They are designed so that one failure does not rewrite the rules of the next one.


What good design looks like when failure is inevitable

A common mistake is to imagine resilience as prevention alone. Prevent the fall. Prevent the emissions. Prevent the outage. But real systems are never perfectly safe, and pretending otherwise is how we build brittle designs.

Better design starts from a more honest premise: failure will happen, so make it cheap.

For older adults with dementia, that means combining environmental changes, balance support, supervision when needed, and interventions that reduce the severity of a fall or the harm that follows it. It means designing homes, routines, and care practices around the reality that cognitive impairment changes how risk is perceived and managed.

For AI, it means asking not only whether a model works, but whether it is the right tool for the task. If task specific software can do the job with far less energy, then the question is not merely performance. It is appropriateness. It means considering model size, routing simple queries to lighter systems, improving hardware efficiency, and accounting for grid impact as part of product strategy, not as an afterthought.

The key is to stop treating efficiency as a purely internal metric. Efficiency must be measured against the broader system it touches. A clever model that saves a few seconds but consumes disproportionate energy may be less intelligent, in practical terms, than a simpler alternative. A care plan that addresses medical conditions but ignores fall dynamics may be less protective than one that reduces exposure to high risk situations.

True efficiency is not doing more with less in isolation. It is doing enough without creating hidden costs elsewhere.


The ethics of scale: when small decisions become public consequences

The overlap between these two domains also reveals a moral dimension. In both cases, the consequences of individual choices are often distributed outward.

A fall may seem like a private event, but its fallout touches families, hospitals, care systems, and public resources. An AI query may seem like a personal convenience, but at scale it contributes to shared energy demand, infrastructure strain, and emissions. The boundary between private action and public cost becomes thin.

That means responsibility cannot stop at user experience. It must include systemic externalities. If a product becomes dramatically more expensive in energy terms as it scales, that cost is not abstract. It is paid in grid pressure, carbon output, and infrastructure overhead. If an environment makes older adults more likely to fall, the cost is not only clinical. It is also human dignity, independence, and social participation.

This is the point where the two stories converge most sharply. Both remind us that what looks like an individual event is often a society level design choice in disguise.

That does not mean every risk can be eliminated. It means every risk should be priced honestly. If we admire powerful systems, we must also account for the fragility they introduce. Otherwise, we are simply outsourcing the damage to a later stage, a different institution, or a more vulnerable person.


Key Takeaways

  1. Do not confuse complexity with resilience. A system can have more features, more power, or more sophistication and still become more fragile.
  2. Look for thresholds, not just causes. Many failures happen when accumulated stress crosses a point the system cannot absorb.
  3. Treat confidence and energy as infrastructure. Both shape what a system can sustain over time, not just what it can do today.
  4. Measure failure costs, not only success metrics. Ask what happens when the system stumbles, and who pays the price.
  5. Prefer tools that fit the task. The smartest solution is often not the largest one, but the one that accomplishes the goal with the least hidden burden.

The real lesson: smarter systems must also become more humble

The deepest connection between falls in dementia and AI energy demand is not that both involve risk. It is that both expose a fantasy of mastery. We build systems that promise convenience, capability, and control, then act surprised when scale reveals their weakness.

But fragility is not a bug in complex systems. It is a property of them. The more tightly optimized a system becomes, the more carefully it must be buffered. The more powerful a tool becomes, the more honest we must be about the consequences of using it widely.

That is why the right question is not, “How do we make the system smarter?” It is, “How do we make it smarter without making the world around it more brittle?”

If we can learn that lesson, we will design better care, better technology, and better institutions. And perhaps the most important shift is philosophical: progress is not the elimination of risk, but the art of reducing how much damage risk can do when it arrives. In that sense, the best systems are not the ones that never fall. They are the ones that know how to fall without breaking everything around them.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣