When the Baseline Breaks: Why Anomalies in Data and Society Begin with Shifts We Refuse to Notice

Xuan Qin

Hatched by Xuan Qin

Jul 19, 2026

8 min read

86%

0

The real danger is not the spike, it is the new normal

What if the most important warning sign is not the sudden eruption people notice, but the slow change everyone learns to ignore? That is the hidden link between anomaly detection in time series and the way climate, heat, and social strain can shape crime. In both cases, the first problem is not finding a dramatic outlier. The first problem is deciding what counts as ordinary once the background itself has changed.

A detector can flag a point that sits outside an interquantile range. A city can register a rise in violence during hotter months. But neither signal becomes meaningful until we ask a deeper question: compared to what? Compared to last week, last year, a typical season, a stable neighborhood, or a world in which heat, scarcity, and crowding have already shifted behavior? The answer determines whether we see noise, anomaly, trend, or the emergence of a new regime.

This is the shared intellectual problem behind data science and social change. We are often very good at noticing the exceptional point, and much worse at noticing the distribution that is moving under our feet.


Anomaly detection is really a theory of expectations

At first glance, anomaly detection looks technical: quantiles, IQR, ESD tests, rolling windows, seasonality, Fourier transforms. But these tools are not merely about statistics. They are different ways of encoding expectations about what the world should look like if nothing unusual is happening.

A quantile-based method says that rare values at the tails deserve suspicion. An IQR-based method says that observations too far from the middle band may be abnormal. The ESD test compares a point’s deviation to what would normally be expected and repeatedly removes extreme points. Each method assumes that the past can define a usable standard for the next value. Each method is, in effect, a machine for asking whether reality still resembles its own recent memory.

That is why time-series anomaly detection becomes complicated the moment seasonality appears. A spike in electricity demand at 6 p.m. may be ordinary, while the same spike at 3 a.m. may be strange. A heat wave in July may be expected, while the same temperature in April may signal something deeper. Context is not decoration in anomaly detection. It is the entire model.

An anomaly is never just a point. It is a point plus a violated expectation.

This is why the distinction between equidistant and non-equidistant time series matters so much. Regular intervals make it easier to compare like with like. Irregular intervals force us to confront a more unsettling reality: sometimes the cadence itself is part of the signal. In social life too, the rhythm matters. Crime does not simply increase or decrease in a vacuum. It changes with weather, crowding, mobility, economic pressure, and the seasons of human behavior.


Heat does not cause crime the way a stone causes a cracked window

There is a temptation to explain the relationship between rising temperatures and crime in a simple mechanical way. Hotter weather makes people more aggressive, aggressive people commit more violence, and crime rises. That story is not useless, but it is too tidy for a messy world. The deeper reality is not direct causation. It is stress accumulation.

Heat changes how people move, gather, sleep, and react. It pushes more people outdoors, increases contact, intensifies discomfort, and reduces tolerance for friction. At the same time, climate-related hardship can contribute to job loss, scarcity, and instability, all of which alter the incentives and emotions surrounding crime. In other words, temperature is not just a physical condition. It is part of a broader state change in the social environment.

This is where the analogy to anomaly detection becomes especially powerful. A naive detector might flag any spike and call it an aberration. But in a hot summer, a rise in violence may not be a random fluke. It may be the visible surface of a seasonal and structural shift. Similarly, a city’s crime data may look anomalous at first glance, but once heat, inequality, and crowding are accounted for, the pattern may reveal itself as predictable, though deeply concerning.

The lesson is subtle but important: not every spike is an anomaly, and not every trend is harmless normality. Sometimes what looks like an outlier is the first sign that the baseline has degraded. A system under sustained stress can produce a sequence of apparently isolated incidents that are actually symptoms of the same underlying change.

Imagine a hospital monitor. A sudden irregular heartbeat matters, but so does the gradual rise in resting heart rate over many hours. One is an event. The other is a condition. A mature diagnostic system must recognize both. So must a society that wants to understand violence in a warming world.


The deeper pattern: systems drift before they break

The most useful idea connecting these domains is baseline drift. A baseline is what we take to be normal, but baselines are not fixed truths. They are negotiated reference points shaped by history, seasonality, and environment. If the baseline shifts slowly enough, it can hide in plain sight. People adapt, algorithms recalibrate, institutions normalize the change, and then the “anomaly” becomes the new routine.

This explains a common failure in both analytics and policy. We often search for dramatic events when the real signal lies in the slow redefinition of normal. In time-series analysis, this means a detector trained on one season may misread another if it ignores cyclical structure. In social analysis, it means crime responses built on historical averages may miss how a changing climate alters the background conditions for conflict.

A useful mental model is to think in terms of three layers of change:

  1. Noise: random variation that should not change our interpretation.
  2. Seasonality: regular, recurring patterns that must be modeled rather than removed.
  3. Regime shift: a genuine change in the underlying system, where the old baseline no longer applies.

This framework is far more powerful than asking simply whether a point is high or low. A summer crime increase may belong to seasonality, but a long-term rise across hotter years may indicate a regime shift. A single extreme temperature reading may be noise, but a cluster of extreme days may mark a structural change in the environment people live inside.

The hardest problem is distinguishing between seasonality and regime shift when the world is warming. As temperatures rise, what used to be seasonal can become persistent. What was once an outlier can become a regularity. That is why climate change is such a profound challenge for interpretation: it bends the very distributions we use to make sense of events.

The future does not always arrive as a shock. Sometimes it arrives as a repeated exception.


What good detection looks like in a changing world

Whether you are monitoring a server, a sales pipeline, or a city’s social stress, the goal is not to find every unusual point. The goal is to distinguish temporary deviation from systemic change. That requires models with memory, but also humility.

The best anomaly systems do at least four things well. First, they compare each observation against a meaningful window of prior values. Second, they respect cyclical structure, because an hour, a month, and a season are not interchangeable. Third, they avoid overreacting to isolated extremes. Fourth, they update when the world changes enough that the old reference frame is no longer valid.

That last point is the most neglected. Many systems are built to detect deviations from the past, but not to ask whether the past itself has become obsolete. In society, this is how warnings get missed. Heat waves, economic stress, and crowding do not merely trigger crimes one by one. They can gradually alter the distribution of risk, making certain kinds of harm more likely across the entire system.

A practical analogy is weather forecasting. You do not predict tomorrow’s rain by looking only for the single biggest cloud. You examine atmospheric pressure, humidity, wind patterns, and seasonal context. The forecast is probabilistic because the world is complex. Anomaly detection should be equally contextual. Crime analysis should be equally ecological.

This has a moral implication too. If we interpret every rise in violence as purely individual failure, we miss the conditions that make such behavior more likely. If we interpret every strange data point as a standalone glitch, we miss the possibility that the environment has become unstable. Better detection is not just smarter measurement. It is better theory about the system being measured.


Key Takeaways

  • Ask “compared to what?” before calling anything abnormal. A spike only means something relative to a baseline, season, or regime.
  • Separate noise, seasonality, and structural change. Not every unusual point is a problem, and not every gradual trend is safe.
  • Treat context as part of the signal. Temperature, crowding, timing, and economic conditions can redefine what counts as normal.
  • Watch for repeated exceptions. When anomalies cluster or recur, they may indicate a shifting baseline rather than isolated events.
  • Update your reference frame when the world changes. A model, policy, or intuition built for yesterday’s climate may misread today’s patterns.

The point is not to catch more anomalies, but to understand what is becoming ordinary

The most revealing thing about anomalies is that they expose the fragility of our definitions. We like to think normality is stable and deviations are rare. But in reality, normality is often just the name we give to conditions we have not examined closely enough. Once heat, scarcity, and seasonal pressure begin to reshape behavior, the border between anomaly and baseline starts to move.

That is the deeper synthesis here. Time-series detection and climate-linked crime patterns are both about how systems warn us before they break. One does it through quantiles, windows, and statistical tests. The other does it through changes in human behavior under environmental stress. In both cases, the real challenge is learning to see not only the event, but the environment that made the event more likely.

So the next time a graph spikes, or a city seems to get rougher in the summer, resist the urge to stop at the surface. Ask whether you are looking at a one-off anomaly, or a world whose baseline is quietly shifting. Because the most dangerous signal is often not the loudest one. It is the one that tells you the old normal is gone, and a new one is already here.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣