We replaced RAG with a virtual filesystem for our AI documentation assistant

Re:We replaced RAG with a virtual filesystem for our AI docu... by shaial on Friday April 03, 2026 @05:34PM (#47632593)

The title says you replaced RAG, but ChromaFs is still querying Chroma on every command — you replaced RAG's interface, not RAG itself. Which is actually the more interesting finding: the retrieval was never the bottleneck, the abstraction was. Agents don't need better search. They need `grep`.

[ Parent | on HN ]

Re:We replaced RAG with a virtual filesystem for our AI docu... by functional_dev on Saturday April 04, 2026 @05:39AM (#47637489)

exactly, embeddings destroy information.. exact keywords, acronyms, etc. They get squashed into floats.

That is why grep still beats it for code.

I generated visual schematic of every stage of the pipeline - https://vectree.io/c/retrieval-augmented-generation-embeddin...

[ Parent | on HN ]