docs / field notes / 1
field note · 1 · the ideas

The Compiled Mind

Why we stopped retrieving and started compiling — and the three disciplines (a page contract, a two-layer vault, and retrieval with zero model calls) that keep an agent-written knowledge base from rotting into confident nonsense.

play with this first

Two ways to answer a question

Same three sources, same question. Toggle the strategy, then press ask.

web clip 4,200 words rfc pdf 31 pages meeting note messy, human source-summary.md cited · EXTRACTED oauth-refresh.md concept · updated 2× seedlings proposed → inbox THE WIKI — compiled once, at ingest "how does the refresh work?" asked at 2am, in a hurry
Pick a mode, then ask.
01 · the karpathy llm-wiki bet

Pay the synthesis cost once

Classic RAG is a promise that similarity search plus a large context window equals understanding. Sometimes it does. But you're re-paying the reading cost on every question, the model free-associates over raw text it has never vetted, and two identical questions can get two different answers depending on which chunks surfaced that day.

The LLM-Wiki idea flips the cost curve: when a source arrives, an agent reads it once, properly — writes a cited Source Summary, folds new facts into the concept pages they belong to, and proposes a couple of atomic notes for the human's inbox. Questions are then answered from the compiled layer: small, curated, cited. The 2am answer above didn't touch the 31-page PDF; it read one section of one page that was written to be read at 2am.

That compile step is hosted now, not aspirational. vault_ingest_source accepts text, HTML, and PDF (extracted with unpdf); Workers AI returns schema-constrained content channels while code constructs the Source Summary, EXTRACTED bullets, citations, inferred marks, directories, and two or three 0-Inbox/ seedlings. Bad model output gets one corrective retry and then fails visibly. The model supplies content; it never gets to invent the trust structure.

the honesty rule that makes it safe

Every compiled claim is marked EXTRACTED (traceable to a source) or *(inferred)* (the agent's synthesis). Synthesis is welcome — disguising it as sourced fact is the failure mode this whole system exists to prevent.

02 · okf v0.1 — the page contract

A format the machine can hold you to

Wikis rot when pages are freeform. OKF ("open knowledge format") is deliberately tiny — a YAML header every page must carry, and a validate command that machine-checks the whole vault. Hover each line:

--- type: Concept title: OAuth Refresh Flow description: How access tokens refresh without re-auth. status: seedling # → growing → evergreen (humans only) sources: [oauth-rfc.pdf] tags: [auth, oauth] --- # then the body: ## sections, wikilinks, and a # Citations list
hover a line to see why it exists —
Fig. 1 The whole contract fits in a screenshot. Small enough that agents follow it; strict enough that validate() can enforce it vault-wide.
03 · para + zettelkasten, coexisting

Your thinking stays yours

A vault is not only the wiki. It's your PARA structure — inbox, projects, areas, resources, archive — plus your atomic Zettel notes, with the wiki layered beside them. The division of labor: the human layer is thinking (ideas in your own words); the wiki is the compiled reference that absorbs the bookkeeping — summaries, cross-references, currency — so you can keep writing instead of maintaining.

HUMAN LAYER — you write here 0-Inbox/ 1-Projects/ 2-Areas/ 3-Resources/ 4-Archive/ +MOCs/ +Templates/ atomic ideas · your own words · agents keep out* WIKI LAYER — agents write here wiki/concepts/ wiki/entities/ wiki/index.md ← the catalog wiki/log.md ← append-only journal compiled · cited · seedlings await your promotion
Fig. 2 *The ownership matrix is per-vault configuration: an assistive vault confines agents to the wiki; an agent-operated one also lets them keep project records. Either way the API enforces it — it's not a suggestion.
04 · deterministic, index-first retrieval

Code before the model

The retrieval hot path contains zero model calls. Extract keywords (lowercase, stopwords out, dedupe). Score the catalog — plus three per hit on an index line, plus two on a filename, plus one on a directory segment — without opening a single page. Take the top page, split on ## headings, return the best section. Done.

That's the whole trick, and it's the one that compounds: retrieval becomes reproducible (same question, same evidence, forever), debuggable (the scores are right there), free (it's string matching), and biased toward the curated layer — the model never free-associates over the corpus, because it's never shown the corpus. It's shown one section of one page and told to cite it.

Try it yourself — the shipped algorithm runs live in chapter 01's query engine.

05 · the trust lifecycle

Agents propose; you promote

The last discipline is the social one, enforced in code twice over: every agent-written page enters as a seedling, and only a human hand moves it forward. Click promote:

seedling
growing
evergreen
a fresh agent-written page — status: seedling
Fig. 3 The gate is checked in the API route and inside the vault's Durable Object. An agent editing an evergreen page knocks it back to seedling — changed content means trust must be re-earned.

Four ideas, one system: compile once, hold pages to a contract, keep the human layer human, and let code do the retrieving. Helios is these ideas with tenancy, auth, and a deploy pipeline wrapped around them — field note 2 walks you from an empty vault to a working one.