The Next Leap in AI Will Come From Better Questions, Not Bigger Models
Hatched by Ante Gojsalić
Aug 29, 2026
11 min read
2 views
92%
What if the most important AI breakthrough is not a model with more parameters, but a system that knows how to ask the same question in several languages, search its memory repeatedly, and revise its answer as evidence accumulates?
That possibility points to a neglected distinction in artificial intelligence: the difference between intelligence stored inside a model and intelligence created by the way a model is used. One kind comes from training on more tokens, increasing parameter counts, and improving the underlying network. The other comes from constructing better interfaces between a question, a body of knowledge, and the model that must reason over it.
The distinction matters because it changes where progress is found. If intelligence is treated mainly as a property of scale, the obvious strategy is to build ever larger systems. If intelligence is also a property of orchestration, then a smaller or more accessible model can become surprisingly capable when paired with multilingual retrieval, repeated passes, carefully constrained evidence, and a disciplined update process.
The deeper lesson is not that scale is irrelevant. It is that scale is only one layer of intelligence.
The Hidden Cost of Asking a Question Once
Imagine asking a librarian, “What caused the fall of Rome?” The librarian searches one shelf, finds a book with a promising title, and gives you an answer based on the first few pages. The answer may be plausible, but it is shaped by the accidents of one search path.
Now imagine a different librarian. She asks the question in English, German, French, Italian, and Spanish. She searches several parts of the collection. After each search, she rewrites the question to incorporate what she has learned, then searches again. She is instructed to use only claims supported by passages she can point to. At the end, she does not merely repeat the first answer. She produces a revised synthesis.
The second librarian is not necessarily more knowledgeable. She has a better epistemic procedure.
This is the significance of multilingual semantic search. A sentence in one language and its equivalent in another language may occupy nearby locations in an embedding space, but they do not occupy exactly the same location. A query such as “give me a greeting” may retrieve an English example more strongly than an equivalent German example. The reverse happens when the query is translated into German. Each language exposes a slightly different route through the same conceptual terrain.
That imperfection is useful. It creates a form of controlled redundancy.
Suppose two passages mean the same thing:
- “How are you?”
- “Wie geht es dir?”
An English query may favor the first passage, while a German query may favor the second. If both searches are combined, the system can recognize that the apparent difference in ranking is linguistic rather than conceptual. The goal is not to make one language perfectly represent another. The goal is to sample meaning from multiple angles and let agreement stabilize the result.
This resembles ensemble methods in statistics. Several imperfect measurements can produce a more reliable estimate than one apparently precise measurement. It also resembles triangulation in navigation. A single bearing tells you a direction. Several bearings help locate the object.
A question is not a single instruction. It is a family of possible searches through a space of meaning.
This reframes retrieval augmented generation. Retrieval is often described as a preliminary step: find relevant documents, then give them to the model. But retrieval can be treated as an active reasoning process. The quality of an answer depends not only on the model’s ability to interpret context, but on whether the system explores the context space sufficiently before interpretation begins.
Scale Stores Capability, Orchestration Activates It
Large language models demonstrate that scale matters. Models trained on trillions of tokens can develop broad linguistic competence, factual associations, and reasoning abilities that smaller systems struggle to reproduce. Yet model size alone does not determine performance in every practical setting.
A smaller foundation model trained on publicly available data has, in some evaluations, surpassed a much larger model trained with vastly more parameters. That observation is important not because parameter count is meaningless, but because it reveals that training efficiency and data quality can compensate for raw size.
The usual mental model of progress is additive: more parameters plus more data equals better intelligence. A more accurate model is multiplicative:
Capability in practice = base model quality × evidence quality × search diversity × revision discipline.
If any factor approaches zero, the final result deteriorates. A powerful model with poor retrieval can confidently miss the relevant passage. A well indexed corpus paired with a model that cannot synthesize context will produce a pile of citations rather than an answer. A capable model given only one search formulation may inherit the blind spots of that formulation.
This explains why access to a large model is not the same as access to a large intelligence system. The model is a compressed reservoir of patterns. The surrounding workflow determines which patterns, documents, and interpretations become available at decision time.
Consider two systems answering the same historical question. System A uses a very large model, one query, and an unrestricted generation step. System B uses a smaller model, five translated versions of the query, several retrieval passes, a rolling answer that is updated with each new batch of evidence, and a rule that every factual claim must be supported by an included citation.
System A may sound more fluent. System B may be more trustworthy.
That difference is easy to miss because fluency is visible while search procedure is hidden. Users see the polished paragraph, not the number of alternative queries attempted, the evidence discarded, or the claims prevented from entering the answer. Yet those invisible operations often determine whether a response is merely plausible or academically defensible.
Repetition Is Not Redundancy When the Question Evolves
Repeated retrieval is sometimes dismissed as wasteful. If the first search returned relevant documents, why run the query again? The answer is that a question changes once it encounters evidence.
The first pass might retrieve material about economic decline. That material may reveal a more precise subquestion: Was the decline caused by taxation, military expenditure, currency debasement, or regional inequality? The second pass can search for that sharper question. The third can test competing explanations. The process is not repeating the same search. It is iterative problem formulation.
A useful framework is the evidence ladder:
- Orientation: Find the broad concepts and vocabulary surrounding the question.
- Expansion: Search for related terms, translations, entities, and competing interpretations.
- Discrimination: Retrieve evidence that distinguishes one explanation from another.
- Verification: Check whether the strongest claims are directly supported.
- Synthesis: Produce an answer that reflects both the evidence and its remaining uncertainty.
A model that updates its answer after each pass is doing something similar to Bayesian reasoning. It begins with a provisional hypothesis, encounters new evidence, and adjusts its confidence. It does not need to calculate formal probabilities to benefit from the structure.
The critical safeguard is citation control. Without constraints, iterative retrieval can make hallucination worse. Each new pass gives the model more material from which to invent connections. Requiring the system to use only claims supported by retrieved sources creates a boundary between inference and fabrication.
This boundary should not be confused with a demand that every sentence be copied from a document. Synthesis is still necessary. The system can compare passages, identify patterns, and explain causal relationships. But it should distinguish among three levels of statement:
- Direct evidence: The source explicitly states the claim.
- Supported inference: Multiple passages justify the conclusion, even if none states it word for word.
- Speculation: The idea is plausible but not established by the available evidence.
Many unreliable AI answers collapse these levels into one confident voice. A better system makes the transitions visible.
The purpose of repeated retrieval is not to collect more text. It is to convert a vague question into a sequence of testable questions.
This principle extends beyond historical research. A legal assistant can begin with a broad dispute, identify the controlling jurisdiction, search for relevant precedent, then test whether later decisions limit it. A medical information system can distinguish symptoms, risk factors, differential diagnoses, and red flag conditions. A business analyst can move from “sales are falling” to questions about segments, channels, timing, price sensitivity, and retention.
In each case, intelligence emerges from the loop between question, evidence, revision, and new question.
Open Models Change the Economics of Better Thinking
The availability of capable models trained on public data has consequences beyond competition among laboratories. It changes who can build these loops and where they can run.
If useful intelligence requires an inaccessible model, expensive infrastructure, and a proprietary data pipeline, then advanced reasoning remains concentrated. If a relatively efficient foundation model can be adapted, inspected, and deployed by researchers, companies, and institutions with modest resources, then the scarce resource shifts.
The scarce resource becomes workflow design.
This is a profound change. A museum with a specialized archive may not need the largest general model. It may need a smaller model connected to carefully digitized catalogs, multilingual metadata, robust retrieval, and a transparent citation policy. A regional government may value local language support and private deployment more than a marginal increase in benchmark performance. A university may prefer a system whose evidence trail can be audited rather than one that produces more eloquent unsupported claims.
Open models are especially valuable in this context because they allow the system around the model to be customized. The institution can decide which data enters the corpus, how documents are segmented, which languages are used for search, how many retrieval passes are affordable, and what counts as sufficient support.
This produces a practical inversion:
Closed systems sell answers. Open systems can help institutions build methods.
The second is often more valuable. An answer is useful once. A method can improve thousands of future answers, and it can be inspected when something goes wrong.
None of this means that open models automatically produce better outcomes. Public availability does not guarantee careful training, strong reasoning, or reliable safety. But openness makes experimentation with the full intelligence stack more feasible. It permits researchers to discover that a modest model with a sophisticated retrieval process may outperform a larger model used naively for a particular task.
The future may therefore belong less to a single universal model than to specialized cognitive systems. Each system combines a foundation model with a knowledge base, search strategy, language set, update loop, and verification policy suited to a domain.
A Practical Design Pattern for Reliable Knowledge Work
The most useful way to apply these ideas is to treat an AI workflow as a small research institution rather than a chatbot. Give it roles, stages, and rules.
Start by building a corpus that has a clear scope. A historical collection should record its sources, languages, dates, and provenance. A vague corpus produces vague retrieval. Better embeddings cannot compensate for poorly defined knowledge boundaries.
Next, create query diversity deliberately. Translate the question into relevant languages, but do not stop there. Generate paraphrases that emphasize causes, mechanisms, chronology, comparisons, and counterarguments. A question about “the impact of inflation” should produce searches about prices, wages, currency stability, purchasing power, and distributional effects.
Then retrieve in stages. The first pass should identify vocabulary and broad relevance. Later passes should target gaps in the developing answer. Store not only the passages retrieved, but also the reason each passage was selected. This makes the workflow easier to debug.
Maintain a provisional answer that is revised rather than replaced. After each pass, ask:
- What does the new evidence strengthen?
- What does it contradict?
- Which important claim remains unsupported?
- What new query would most reduce uncertainty?
Finally, impose an evidence budget and a stopping rule. More retrieval is not always better. Stop when additional passes produce little change, when the major claims have adequate support, or when the remaining uncertainty is irreducible within the corpus.
A compact implementation might look like this:
- Define the question and the required level of confidence.
- Generate multilingual and conceptual query variants.
- Retrieve evidence from each variant.
- Deduplicate passages while preserving independent support.
- Draft a provisional answer with claim level citations.
- Identify unsupported or contested claims.
- Run targeted searches for those gaps.
- Revise the answer and label uncertainty.
The point is not to force every task through twenty passes. The point is to make the number of passes a conscious design choice. Simple questions may need one. High stakes questions may need many.
Key Takeaways
- Treat multilingual search as triangulation. Different languages can expose different retrieval paths to the same concept. Combine them when recall and reliability matter.
- Separate model scale from system capability. A smaller model can perform exceptionally when paired with strong data, retrieval, and revision procedures.
- Use repeated retrieval to refine the question. Each evidence pass should generate sharper subquestions, not merely more context.
- Make evidence levels explicit. Distinguish direct support, supported inference, and speculation so that fluency does not disguise uncertainty.
- Design workflows, not just prompts. Define the corpus, search strategy, update loop, citation rules, and stopping conditions before judging the model’s performance.
The central mistake in current AI thinking is to imagine intelligence as something that sits entirely inside a model. Models matter enormously, but much of the intelligence users experience is produced outside the weights: in the choice of documents, the diversity of queries, the order of operations, and the rules governing revision.
A larger model gives you a deeper reservoir. A better workflow gives you a better way to draw from it. When open and efficient models meet multilingual retrieval and iterative evidence gathering, the result is not simply cheaper artificial intelligence. It is a different theory of what intelligence is.
Perhaps the next great AI system will not be the one that remembers the most. It will be the one that knows how to look again, ask differently, and change its mind for reasons it can show.
Sources
Hatch New Ideas with Glasp AI 🐣
Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)
Start Hatching 🐣