What You Say Is an Experiment: How Conversations Must Be Designed to Find Truth
Hatched by Wayne Marsh
Apr 16, 2026
9 min read
6 views
88%
A single unsettling question
What you say is not what comes out of your mouth, it is what enters the ears of your listener. That sentence is simple and modest, but it contains a radical conclusion: communication is not a transmission, it is an experiment. You do not merely deliver facts; you expose a hypothesis to a testing environment: another human mind. If you want knowledge to improve, your speech must be arranged so that it can fail fast and fail safely, and your listening must be arranged so that it prioritizes severe tests of content, not authority.
This essay takes that thought seriously. It draws a direct line from how meaning is produced in conversation to how knowledge itself advances. It argues that most social pathologies around disagreement, from defensive experts to polarized publics, come from treating utterances as verdicts rather than conjectures. I will show practical ways to reframe speaking, listening, and institutional design so that ideas are tested quickly, criticism is substantive, and error becomes the raw material of improvement.
The anatomy of a communicative experiment
Imagine two people in a room. One says, with steady confidence, "Do X." The other hears, remembers, and acts. The first believes the message transmitted; the second may have interpreted it in dozens of ways. The words that left the mouth are only part of the story. What matters is the map that those words create in the listener's head. That map is shaped by prior beliefs, vocabulary, context, mood, attention, and available tests.
This mismatch matters because our minds are fallible. Our perceptions are not direct copies of the world; they are constructed, provisional, and error prone. Memory is compressive and reconstructive. Conviction feels like knowledge, but intensity of conviction has no bearing on truth. These are not theoretical quibbles. They are practical constraints. If knowledge is fragile, then the social process that creates knowledge should be built to detect and eliminate error, not to coronate certainty.
Two consequences follow immediately:
- Speaking without regard for how a message will be received is epistemically reckless. A confident assertion under the illusion of clarity can mislead as effectively as a lie.
- Listening that defers to pedigree or tone rather than to the content of the argument encourages dogma and slows correction.
So we must treat speech as an experimental intervention. Every claim presented should be a conjecture that invites attempts at refutation. And every listener should be a critic whose job is not to prove the speaker wrong as an adversarial sport, but to subject the claim to severe tests that reveal its weak points.
From philosophical fallibilism to conversational practice
There is a philosophical stance that makes this practical: fallibilism. Fallibilism says that no source of knowledge is infallible. There are no unquestionable foundations, only ideas that survive repeated, rigorous attempts at falsification. This does not mean skepticism about progress. It means designing institutions and habits so that errors are discovered and corrected.
If you accept that, then conversations should aim to be error-finding laboratories. Here are the core moves that convert ordinary talk into a productive epistemic process:
-
Make claims testable. A good claim comes with a clear statement of what would count as evidence against it. If a doctor recommends treatment, they should describe the specific outcomes, time windows, and alternative explanations that would force reconsideration. If you say "2 plus 2 equals 4," be explicit about the notation, the domain, and the question you are answering.
-
Separate person from proposition. Criticism should target content, not source. Deference to expertise is appropriate when the expert has shown their ideas to have been subjected to severe tests that are relevant to the present case. But pedigree is not a substitute for transparency about how an idea handles counterexamples.
-
Invite error signals. Make it easy for others to point out problems. This means saying what you assume, what you did not check, and where your uncertainty lies. An assertion that hides uncertainty shields itself from meaningful critique.
-
Practice low-cost failure. Wherever possible, run thought experiments, simulations, or small pilots so that mistakes occur in controlled settings. "Let our theories die in our place," as a good maxim: expose hypotheses to tests before they govern high-stakes action.
-
Reward speed of honest correction. In cultures that punish error as moral failure, people hide mistakes. If instead the social reward attaches to rapid correction and learning, the whole system becomes more reliable.
These moves are not abstract. They show up in effective practices across fields: code reviews with unit tests, randomized trials in medicine, pre-mortems in project planning, and the method sections of scientific papers that allow replication. The novelty here is to treat everyday conversation as amenable to the same engineering logic.
Three practical protocols you can use in conversations today
Below are compact protocols for speakers, listeners, and group leaders. They convert the philosophical insight into concrete behaviors.
The Speaker Protocol: Conjecture, Context, Tests
When you make a claim, perform three small rituals:
- State your claim as a conjecture. Replace "This is the way" with "My current hypothesis is" and then say what evidence would count against it.
- Provide context and boundary conditions. Say where the claim applies, what assumptions you are making, and what you have not checked.
- Suggest a simple, falsifiable test or observation. If none exists, explain why. If a claim cannot be tested even in principle, treat it as a policy preference or an aesthetic judgment rather than a factual claim.
Example: A doctor could say, "My hypothesis is that this drug will reduce pain within 48 hours for patients with X. If pain does not reduce by half in 72 hours, or if side effects A or B appear, we will stop. I am assuming no interaction with medication Y, which I have not checked in your chart. Would you like me to check for that?"
The Listener Protocol: Content-First Critique
When you hear a claim, follow these steps before delegitimizing the speaker:
- Translate their words into a formal conjecture: what exactly would have to be true for this claim to be false?
- Ask for the assumptions and the relevant counterevidence. If they cannot state assumptions, ask whether they really have a factual claim or an opinion.
- Offer a focused test or counterexample, and reserve judgment until you see whether the claim passes that test.
This protocol prevents the common mistake of rejecting an idea because you dislike the speaker or because you think they are naive. It focuses attention on the argument's performance in the world.
The Group Leader Protocol: Create Safe Spaces for Error
Design meetings and institutions so that mistakes are low-cost and visible:
- Require pre-mortems and small-scale pilots before committing to irreversible action.
- Make it a norm to annotate proposals with explicit failure modes and test criteria.
- Reward the person who spots a problem early. Make error correction more prestigious than bravado.
In engineering this looks like staged rollouts and feature flags. In management it looks like transparent postmortems that focus on systems rather than blame.
Concrete examples that expose how fragile our everyday epistemic practices are
Example 1: The arithmetic illusion. If you write "2+2" on a test when asked to add two and two, your answer might be marked incorrect because you responded in the wrong mode. The mismatch is not about arithmetic truth; it is a communicative mismatch about the representation the examiner wanted. Treating mathematical truths as simple repositories of certainty ignores the protocol that links representation and assessment.
Example 2: The wounded soldier who does not feel pain. A medic who believes stubbing the toe always hurts will make a bad triage decision on the battlefield. Direct experience is not reliable in isolation. What appears to be an immediate, self-evident signal can be suppressed for reasons that matter. Training that assumes infallible perception will fail when real variability appears.
Example 3: The physician and the patient. The question is not who is more likely to be right, but whether the physician's recommendation has been subjected to severe tests that are relevant to this patient's case. If not, deferring because of the physician's credentials is epistemically irrational. Patients who ask the right questions and insist on explicit failure criteria improve outcomes.
These examples show the same pattern: high conviction plus poor testing produces brittle knowledge. Low conviction coupled with robust testing produces reliable outcomes.
Toward an error-embracing epistemic culture
What would a society look like if conversations were routinely treated as experiments? Here are some plausible features:
- Education would teach students not just to memorize facts, but to state hypotheses, enumerate assumptions, and design simple tests. Error would be a learning signal, not a badge of shame.
- Organizations would prefer iterative pilots over grand pronouncements. Leadership would reward course corrections.
- Public discourse would emphasize substantiation. Arguments that cite sources would also show how those sources were tested and what failed attempts revealed.
None of this is utopian. We already have elements of it in labs, software engineering, and clinical trials. The challenge is to extend the logic to ordinary speech so that private conviction does not masquerade as public fact.
What you say is not a verdict, it is an invitation to a test. The honor of the speaker is not in being right, but in making it easy to find out whether they are right.
Key Takeaways
- Make claims testable: state what would count as evidence against your position, and indicate assumptions explicitly.
- Listen as a critic, not an adjudicator: focus on content and propose specific tests before deferring to authority.
- Design low-cost failure modes: run pilots, thought experiments, or simulations so that mistakes are revealed in safe contexts.
- Reward correction, not immutability: celebrate rapid error detection and updating in institutions and teams.
- Separate facts from values: if a statement cannot be tested, treat it as a preference and discuss it as such.
A final reframing
We like to imagine that talk is a transfer of truth, like handing someone a book. That image is misleading and dangerous. Talk is a ritual of proposal. Every assertion we make is a tiny experiment that will either survive or fail. If you care about truth, be deliberate about the experiments you launch and the tests you accept. Make it easy for others to disconfirm you. Invite the kind of criticism that hurts the claim, not the person. That is the only practical route from private conviction to public knowledge.
If you remember one thing, remember this: clarity and humility are not signs of weakness, they are engineering decisions that make your ideas more reliable. Speak so your claim can be proven wrong quickly. Listen so you can change your mind when the evidence arrives. Knowledge is not a trophy we hold up; it is a process we design together.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣