# Canopy

Let a model do the tidying overnight, and let the reader walk a tree no more than seven wide.

Pilot results · d/rksci research · Published 2026-10-08 · Tags: Agent Memory, Retrieval, MemoryAgentBench, LongMemEval, Engram, Hierarchy, LLM Curation

Is a tree built by a model easier to search than a flat list?

Hierarchies make long stores navigable for people. A curator model can build one at write time, once, and every later read pays less. Whether the reads also get more accurate is the open part.

## 1. Idea

Experiment 9 of 10 in the Engram series. [← Coral](/engram/coral) · [Engram overview](/engram) · [Glyph →](/engram/glyph)

The store keeps the raw record as the source of truth and builds a tree on top of it. The bottom tier is the original entries, the middle tier groups them into topics, and the top tier is a few short summaries. A curator model, running offline and slowly, does the grouping and writes the summaries. A reader starts at the top, picks which of at most seven children to open, and repeats until it reaches entries. Seven is borrowed from the hexagonal grid the idea is named after, where a cell has six neighbours.

**Canopy · three tiers.** A slow offline curator groups the raw entries into topics and summaries, none wider than seven; at query time a read descends the tree and ranks the entries it reaches.

The tree is derived and disposable. Rebuild it and the grouping may come out differently, which the design accepts: a question about two topics should still find both by their shared ancestry whichever way the boundary falls.

## 2. Where it came from

The archived H3 was a curator (Haiku), three tiers of markdown nodes, and node ids made from a hash of the title so that a stable cluster keeps its identity across rebuilds. It was tested once, on the first twenty questions of one conversation from the LoCoMo benchmark, using only the first 200 turns. BM25 got none of them and H3 got one. Each query took about two minutes.

The audit found that the two numbers were not the same kind of thing. BM25’s score was whether the answer string appeared in the retrieved text, a recall measure. H3’s was whether a model’s written answer contained the gold, an accuracy measure. A BM25 score of zero for a keyword method on that data is odd enough that a matching bug is the likelier explanation. The match rule accepted a prediction contained in the gold answer, so a very short answer could pass. The “seven” was never enforced: the curator made five to fifteen clusters of any size. And the script’s docstring called its metric the benchmark’s official one, which it was not.

## 3. Hypothesis

Stated before running. Navigating a curated tree and then ranking the entries it reaches with the same dense scorer beats Dense alone at recall\@5 on LongMemEval_S for the question types that ask about a topic across several sessions, and costs more per question.

Cost matters here. Curating a haystack takes a model call per question, and a hundred questions means a hundred haystacks. A method that needs minutes per query counts as unusable for an agent, and the table will say what each query cost.

## 4. Design

**Curator.** A language model builds the tree for each haystack once, with a fixed prompt and a hard cap on calls per run, written into the run record. The prompt is the archived one: summarise without inventing, name clusters by what they are.

**Width.** Seven, enforced this time. A node with more than seven children is split before the tree is used.

**Navigation.** The reader descends from the top and the entries it reaches are ranked by the dense scorer, so the output is a ranked list of at most k session ids.

**Where it runs.** LongMemEval_S, tier 0 only. The curation bill is why: it is paid once per haystack. The \~500-session LongMemEval_M run goes ahead only if the cost cap allows it. FactConsolidation is not run for Canopy.

**Seeds.** Curation is not deterministic, so if the budget allows it the tree is built twice per haystack and the two scores are reported.

## 5. How it is tested

The measurement is session recall\@5, recall\@10 and NDCG\@10 against the official LongMemEval ground truth, which is a retrieval measure and the same one Dense and BM25 are scored on. The comparison is Canopy against Dense, paired, with the cost per question beside it. The published structure-augmented rows (RAPTOR, GraphRAG, MemoRAG) are in the table for context. They are MemoryAgentBench numbers, a different benchmark, which is why Canopy’s own MemoryAgentBench cells are n/a.

The standing rules for every Engram experiment apply here unchanged.

## 6. Results

## 7. What would change the conclusion

- If Canopy does not beat Dense at equal k, a tree built by a model has not made this store easier to search, and the cost buys nothing.
- If it wins on recall and costs minutes a question, it is a result about cost, not usefulness, and the page will report it that way.
- If two builds of the same haystack differ by more than Canopy differs from Dense, non-determinism is the finding.

## Sources

Experiment 9 of 10 in the Engram series. [← Coral](/engram/coral) · [Engram overview](/engram) · [Glyph →](/engram/glyph)

Canopy is one of ten experiments in Engram. Its rows come from one run on the pilot sets.