Why Knowledge Must Be Drawn Before It Can Be Measured

Periklis Papanikolaou

Hatched by Periklis Papanikolaou

Jul 12, 2026

9 min read

84%

0

The hidden problem with knowledge is that it is not born as data

What if the biggest obstacle to building a better Knowledge Graph is not the graph part, but the knowledge part? We keep acting as if meaning can be extracted cleanly from text, encoded in vectors, and evaluated with a neat score. But human understanding does not begin as a tidy structure. It begins as a sketch: rough, incomplete, visual, provisional, and deeply interactive.

That is the tension at the center of modern knowledge systems. On one side, we want machines to represent meaning, connect concepts, and quantify how well they do it. On the other side, humans do not think in finished ontologies. We think in fragments, gestures, examples, and evolving mental maps. The most important question is not whether a Knowledge Graph can capture human knowledge. It is whether it can capture knowledge before it hardens into something machine-friendly.

This is where the simplest interface can become the most revealing one: the ability to draw data directly inside a notebook. A drawing tool seems almost too humble to matter. Yet it exposes a profound truth. When we draw, we are not merely annotating data. We are externalizing structure that has not yet been formalized. We are converting intuition into a form that can be inspected, compared, and eventually computed on.

That is not a small convenience. It may be the missing bridge between human cognition and machine evaluation.


A sketch is not a toy model, it is a thinking instrument

Most knowledge systems begin with a false assumption: that the world is already organized in a way that can be captured by predefined labels. In practice, the first useful version of any domain map is almost always hand drawn. A doctor scribbles symptoms and relationships on a whiteboard. A product team maps user journeys on paper. A scientist draws a mechanism with arrows that are still ambiguous. In each case, the drawing is not decoration. It is the earliest executable form of understanding.

That matters because a drawing has three properties that formal knowledge representations often lack:

  1. It preserves uncertainty. A drawn connection can be tentative. An arrow can mean “probably related,” not “logically proven.”

  2. It supports revision. Humans do not refine ideas by starting from a perfect schema. They revise sketches repeatedly, erasing, circling, regrouping, and relabeling.

  3. It makes structure visible before semantics are stable. Sometimes we recognize a pattern by seeing its shape, not by naming every part.

This is why drawing inside a notebook is more than a nice interface feature. It is a way of keeping knowledge in its native state for longer. Instead of forcing a premature translation into rigid categories, it lets structure emerge in the same workspace where analysis happens.

A good sketch is not an approximation of knowledge. It is knowledge in the act of becoming legible.

That insight changes how we should think about knowledge graphs and embeddings. They are not just storage or compression systems. They are attempts to finish what drawing began.


The score problem: when representation starts pretending to be understanding

The impulse to assign a single number to a knowledge system is understandable. Metrics provide clarity. They promise comparability. They help us ask whether one graph is better than another, whether one embedding technique captures meaning more faithfully, whether the system has actually modeled the domain.

But the deeper issue is that measurement changes the object being measured. Once we optimize a score, we often reward representations that are easier to evaluate rather than more faithful to human meaning. A graph can become elegant, connected, and numerically strong while still failing at the one thing that matters most: capturing the lived, contextual, messy way people actually know things.

This is not a failure of math. It is a mismatch of levels.

A Knowledge Graph is good at answering questions like:

  • What is connected to what?
  • Which entities cluster together?
  • What paths exist between concepts?

An embedding is good at answering questions like:

  • Which things feel similar in meaning?
  • What latent dimensions compress the space well?
  • Which relationships are implicit rather than explicit?

But human knowledge also contains:

  • Tacit judgment
  • Context-specific exceptions
  • Contradictions that are not mistakes but signals
  • Analogies that are powerful even when not strictly true
  • Intuition that can be drawn but not yet formalized

The central trap is to confuse a representation score with a knowledge score. The first tells us how well a system reproduces a chosen structure. The second would need to tell us how well that structure matches the way understanding actually works.

Those are not the same thing.

Think about a map. A subway map can be beautifully precise and still be useless for navigation on foot. A political map can show borders clearly and still tell you nothing about economic flows. The score of the map depends on the task. Likewise, a Knowledge Graph can be excellent at representing a domain while still missing the fluid, sketch-like nature of actual cognition.

That is why the drawn layer matters. It gives us a way to capture not only the finished map, but the process by which the map is created.


The missing layer between raw thought and formal knowledge

The real opportunity is not to choose between drawing and graphs. It is to understand them as two halves of a larger cognitive pipeline.

Stage 1: Sketch

This is the human stage. Ideas appear as shapes, arrows, clusters, and notes. Ambiguity is allowed. The goal is not precision, but discovery.

Stage 2: Structure

This is the transformation stage. The sketch is converted into entities, relationships, and constraints. The goal is to preserve meaning while adding form.

Stage 3: Evaluation

This is the machine stage. The graph and embeddings are tested against tasks, questions, or expert judgments. The goal is to estimate whether the representation is useful.

The mistake many systems make is trying to begin at stage 2 or 3. They assume knowledge already exists in structured form. But human understanding often needs stage 1 as a legitimate computational artifact, not a discarded prelude.

This is where drawn data becomes surprisingly powerful. A drawing can encode multiple kinds of information simultaneously:

  • Spatial proximity, which suggests association
  • Line thickness or color, which can indicate confidence or importance
  • Grouping, which can imply hierarchy or category
  • Revision marks, which preserve the evolution of thought

These are not just visual conveniences. They are semantic signals. A sketch contains a richer temporal story than a static graph snapshot. It tells us not only what is connected, but how the connection emerged, how confident the thinker was, and where the uncertainty lives.

That makes it invaluable for building and evaluating knowledge systems. A graph may tell you the final answer. A sketch tells you the reasoning path.


Why embeddings and graphs should learn from drawings

There is a subtle weakness in many modern knowledge pipelines: they often treat human input as a source of facts, not a source of structure. A person is asked to label, validate, or correct. But what if the person is better used as a cartographer of meaning?

A drawing tool inside an analytical notebook lets someone externalize a domain the way they actually perceive it. Instead of feeding the system only a list of entities and relations, you feed it the geometry of thinking:

  • what sits near what
  • what is grouped with what
  • what deserves emphasis
  • what remains uncertain

That geometry can inform both the graph and the embedding.

For graphs, drawings can reveal candidate nodes and edges that a formal schema would miss. For embeddings, drawings can reveal the neighborhood structure of meaning, showing which concepts are close in practice even if they are far apart in taxonomies. For evaluation, drawings can serve as a human baseline, not because they are perfectly precise, but because they preserve the form of understanding before it is compressed.

Here is the deeper idea: drawings are not inferior to graphs, they are upstream of them.

A graph is a cleaned up claim about reality. A drawing is a working hypothesis about how reality is organized. If your system cannot learn from the second, it will always be late to the first.


The new test of a knowledge system: does it respect ambiguity?

The best knowledge systems are not those that eliminate ambiguity fastest. They are those that hold ambiguity long enough to become intelligent about it.

That suggests a different evaluation framework. Instead of asking only, “How well does the graph capture domain knowledge?” ask three questions:

  1. Can the system preserve the user's uncertainty without flattening it? If a person draws a tentative relationship, does the system keep it tentative?

  2. Can the system move from sketch to structure without losing meaning? Does the formalization process retain the important parts of the original intuition?

  3. Can the system support revision as a first-class operation? Does it treat changing your mind as a feature, not noise?

This reframes evaluation from static correctness to cognitive fidelity. A good knowledge system is not one that merely stores answers. It is one that can participate in the creation of answers.

Consider a medical example. A clinician may draw symptoms, triggers, and possible diagnoses around a patient case. The diagnosis graph may later become highly structured and score well against a benchmark. But the original sketch captures something the benchmark cannot: which symptoms felt salient, which connections were tentative, which alternative explanations were alive. That is not ancillary information. It is the actual texture of expertise.

Or think about software architecture. A team may draw service boundaries, data flows, and points of failure before formalizing them in a diagramming tool. A graph representation can capture dependencies. Yet the sketch reveals the team's current mental model, including hotspots of confusion. A good system would use both, not privilege only the polished layer.

Human knowledge is often less like a database and more like a drafting table.

That sentence should change how we build tooling.


Key Takeaways

  • Treat sketches as structured data, not disposable notes. They contain confidence, hierarchy, proximity, and uncertainty, all of which matter.
  • Do not confuse representation scores with understanding. A high metric can hide a poor fit to human cognition.
  • Design systems with a sketch to graph pipeline. Let people draw first, then convert those drawings into entities and relations.
  • Preserve uncertainty explicitly. A tentative connection is often more informative than a forced binary relation.
  • Evaluate cognitive fidelity, not just formal accuracy. Ask whether the system retains the shape of human reasoning.

Conclusion: the graph is not the mind, it is the cleaned up residue of a mind at work

The deepest mistake in knowledge technology is assuming that meaning is best captured when it is most formal. In reality, meaning is often clearest at the moment it is most provisional. A sketch is not a crude version of a graph. It is a different epistemic state altogether: one that remembers how knowledge felt before it was pinned down.

So the question is not whether a Knowledge Graph can capture human knowledge. The better question is whether it can respect the way human knowledge is formed: through drawing, revising, comparing, and living with uncertainty long enough for structure to emerge. If it can do that, then evaluation by score becomes meaningful. If it cannot, then the score will only measure how well we compressed a thought, not how well we understood it.

The future of knowledge systems may depend on a simple reversal: before we ask machines to infer the world, we should let humans draw it.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣