When Evidence Needs a Voice: The Hidden Politics of Proving Change
Hatched by Anemarie Gasser
May 31, 2026
10 min read
2 views
88%
The hardest question in social change is not whether something worked
It is this: who gets to say it worked, and in what language?
That question sounds academic until you look at how change is actually judged. A program is funded because a graph moved. A policy is defended because a statistic improved. A community project is dismissed because the numbers are too messy, too local, too human. In theory, evaluation is about truth. In practice, it is often about whose version of truth becomes legible.
This is where a quiet tension opens up. One side of the problem asks for causal confidence: if we invest resources, can we trace the pathway from action to outcome? The other side asks for epistemic justice: if people experience change in ways that standard metrics cannot easily capture, do they still get to define what counts as success? Put differently, one tradition wants to know how change happened. The other wants to know who is allowed to narrate it.
The deepest insight is that these are not separate problems. They are the same problem seen from different angles.
Causality is never neutral, because measurement is never neutral
We like to imagine that evidence sits above politics. In reality, every evaluation design smuggles in a theory of the world. If you choose only what is easy to count, you also choose what can be ignored. If you define success in advance, you also define whose surprises matter. If you ask for causal proof in a rigid format, you often privilege the voices that already know how to speak in institutional language.
That does not mean causal reasoning is useless. It means causality is a story we tell responsibly, not a machine that spits out truth automatically. In complex social settings, especially those shaped by inequality, the pathway from intervention to result is rarely linear. A workshop may not produce immediate behavior change, but it may change how participants speak to each other. A legal aid clinic may not remove oppression overnight, but it may alter the felt possibility of action. A health campaign may not shift every indicator, but it may create trust, dignity, and the courage to ask for help.
These are not soft outcomes. They are often the very mechanisms through which harder outcomes become possible.
If you cannot hear the mechanism in people’s stories, you may mistake silence for failure.
The problem is that traditional evaluation frameworks often demand a clean causal chain when reality offers a braided one. Change in human systems is more like weather than like a switch. Multiple forces interact, feedback loops emerge, and meaning itself changes as people adapt. In that environment, the question is not whether we can prove impact with absolute certainty. The real question is whether our method is disciplined enough to distinguish signal from noise without erasing lived experience.
Narrative is not decoration. It is a method of knowing
Stories are often treated as illustrations, as if they merely make results more relatable. That is a profound misunderstanding. Narrative is not the frosting on the evidence cake. It is a way of organizing evidence itself.
When people tell the story of change, they do more than report feelings. They reveal sequence, causation, resistance, contradiction, and meaning. They show which moments mattered, which relationships shifted, and which obstacles were invisible to outsiders. A narrative can expose a mechanism that a survey would flatten into a score. It can show how policy feels at the point of contact, where official categories meet real life.
Consider a community food project. A numeric evaluation might report improved household food security. Useful, yes. But a narrative approach can reveal something deeper: maybe the real change was not only food access, but reduced shame, more mutual aid, and a renewed sense that neighbors are not competition but infrastructure. Those are causal ingredients too, even if they do not fit neatly into a spreadsheet.
This is especially important in contexts marked by colonial histories and gendered power. In such settings, whose story gets recorded is never innocent. Research that claims to be objective can still reproduce extraction, where participants supply raw material and institutions convert it into prestige. Narrative methods, when done seriously, push back against that. They insist that people are not just data points in someone else’s explanatory model. They are interpreters of their own worlds.
That shift matters because it changes what counts as evidence. It says that experience is not anecdote when the experience itself reveals how power works.
The real innovation is not choosing between rigor and voice, but redesigning rigor around voice
The usual debate is sterile because it assumes a false tradeoff. We are told to choose between hard evidence and meaningful participation, between causal rigor and decolonial ethics, between numbers and narratives. But the most interesting work happens when rigor is expanded rather than diluted.
A better framework is to ask three questions together:
- What changed?
- Through what pathway did it change?
- Who can credibly describe that pathway, and in what terms?
The first question keeps evaluation anchored in outcomes. The second prevents us from mistaking correlation for explanation. The third prevents us from turning explanation into domination.
This is where contribution thinking and narrative thinking become deeply complementary. Contribution analysis, at its best, accepts that social programs rarely cause outcomes in isolation. Instead, it looks for plausible chains, alternative explanations, contextual factors, and evidence that the intervention made a meaningful contribution. Narrative methodology, especially when informed by decolonial and feminist commitments, asks whether the very categories used to judge contribution are themselves shaped by power.
Together, they suggest a richer discipline: trace the pathway, but let the people who lived it help define what counts as a pathway.
Imagine evaluating a domestic violence support service. A narrow approach might ask whether reported incidents dropped. A more layered approach would ask whether women gained safety, whether their language for naming abuse changed, whether they understood options differently, whether informal support networks strengthened, and whether the service reduced isolation. A narrative lens might show that the most important effect was not immediate exit from violence, but the recovery of decision making. A contribution lens would then ask how the service interacted with legal, social, and familial factors to make that recovery more likely.
That combination is more honest than a simple before and after comparison. It is also more useful.
A useful mental model: evidence as a braid, not a ladder
Most institutions still operate with a ladder model of evidence. At the top sit randomized experiments and quantified indicators. Lower down sit interviews, testimonies, case studies, and stories. This hierarchy is convenient, but it is intellectually lazy. It treats different kinds of knowledge as if they were competing for the same crown.
A better model is the braid.
In a braid, different strands retain their identity, but their strength comes from being intertwined. One strand might be statistical pattern. Another might be institutional record. Another might be lived narrative. Each strand can fray if handled alone. Together, they support a stronger account of reality.
This model changes evaluation in several ways:
- A survey result tells you the pattern.
- A narrative tells you the mechanism from the inside.
- A process trace tells you the sequence of events.
- A contextual analysis tells you why the same intervention may work differently elsewhere.
The point is not to make every method do everything. The point is to stop asking one method to carry the whole burden of truth.
This matters especially when power is unequal. In extractive systems, dominant institutions often demand that marginalized people translate their lives into preapproved formats. The braid model reverses that burden. It lets evidence travel in multiple forms, while still being disciplined enough to support decisions. That is not a compromise. It is an upgrade.
Rigor is not the absence of story. Rigor is the capacity to distinguish story from propaganda, and lived meaning from institutional convenience.
Why decolonial and feminist thinking changes the rules, not just the tone
It is tempting to treat decolonial or feminist approaches as adding sensitivity to an otherwise standard method. That understates the challenge. They do not merely ask for kinder research practices. They question the underlying architecture of knowledge production.
Who frames the question? Who benefits from the answer? Which experiences are rendered credible, and which are dismissed as emotional, partial, or unscientific? These are not side issues. They determine what kind of evidence can even exist.
A decolonial feminist lens reveals that evaluation often reproduces hierarchy under the banner of neutrality. For example, communities are asked to demonstrate resilience without being given power. Women are asked to share testimony in systems that may still fail to protect them. Indigenous groups are invited to participate in research agendas designed elsewhere. In each case, the appearance of inclusion can mask continued control.
That is why the promise of narrative is not simply that it captures richer detail. Its deeper promise is that it can redistribute interpretive authority. It allows those most affected by an intervention to shape the meaning of its effects. In doing so, it challenges the old assumption that the evaluator stands outside the world being evaluated.
The evaluator is not outside. The evaluator is inside the power relations. The only question is whether those relations are acknowledged or hidden.
This reorientation has practical consequences. It means evaluation should not only be participatory at the stage of data collection. It should be participatory at the stages of framing, interpretation, and use. Otherwise, participation becomes a procedural ornament. Real participation means people can contest categories, redefine success, and reject interpretations that distort their experience.
What this means in practice: from proving impact to learning responsibility
If the old model asks, “Did we cause this outcome?”, the deeper question is, “What responsibilities do we have for the changes we helped make possible?”
That shift is subtle but transformative. It moves evaluation away from the fantasy of total control and toward the ethics of contribution. Most interventions do not create outcomes alone. They enter already crowded social fields, where institutions, histories, relationships, and inequalities all matter. Responsible evaluation recognizes that complexity instead of pretending it is a nuisance.
Here is a practical way to think about it:
-
Start with a change claim, but make it tentative. Not “we caused this,” but “we may have contributed to this by influencing these conditions.”
-
Map the pathway, not just the endpoint. Identify intermediate shifts in trust, language, access, confidence, coordination, or legitimacy.
-
Invite counter-narratives. Ask who would tell a different story about the same change, and why.
-
Check for power blindness. Ask whether your metrics reward compliance more than transformation.
-
Let interpretation remain open long enough to learn. The first explanation is often the institution’s explanation, not the truth.
A youth mentorship program offers a concrete example. If attendance rises, that is useful. But the deeper change may be that young people begin to imagine a future worth planning for. The causal pathway might include one trusted adult, a safer meeting space, a shift in peer norms, and a new sense of being seen. A purely numerical report might confirm attendance. A narrative account might reveal restored agency. Together, they show not only whether the program worked, but how human possibility expanded.
That is the kind of evaluation people remember, because it respects both evidence and dignity.
Key Takeaways
- Treat evidence as a braid, not a hierarchy. Combine pattern, pathway, and lived meaning rather than ranking one above the others.
- Ask who gets to define success. Every evaluation framework contains an implicit politics of credibility.
- Trace mechanisms through narrative. Stories often reveal intermediate changes that standard indicators miss.
- Redesign rigor around participation. Involve communities not only as respondents, but as co-interpreters.
- Use contribution thinking to stay humble. Focus on plausible influence and responsibility, not false claims of total control.
The most honest question is not “Did it work?”
It is, what kind of change became possible, through whom, and at what cost of being heard?
That question is more demanding than a simple impact claim, but it is also more mature. It accepts that social change is never just technical. It is interpretive, relational, and political. It depends not only on what happened, but on whose account of what happened is allowed to survive.
The future of evaluation will not be decided by whether we choose numbers or stories. It will be decided by whether we can build methods that let numbers remain accountable to stories, and stories remain disciplined by evidence. When that happens, proof stops being a weapon of authority and becomes what it should have been all along: a tool for learning, repair, and more truthful forms of collective action.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣