We replaced RAG with a virtual filesystem for our AI documentation assistant

Re:We replaced RAG with a virtual filesystem for our AI docu... by safety1st on Saturday April 04, 2026 @12:45AM (#47635843)

I agree it makes no sense. The whole point of chunking is to handle large documents. If your chunking system fails because a document is too big, that seems like a pretty glaring omission. I just chalked it up to the tech being new and novel and therefore having more bugs/people not fully understanding how it worked/etc. It was a vendor and they never gave us more details.

Not all problems have to be solved. We just fell back to using older, more proven technology, started with the simplest implementation and iterated as needed, and the result was great.

[ Parent | on HN ]

Re:We replaced RAG with a virtual filesystem for our AI docu... by bartread on Monday April 06, 2026 @04:33AM (#47658296)

That's good. I think if you can get the result you need with a technology that's already familiar to you then, in cases where that tech is still supported, that's going to be a win.

RAG worked well for us in this recent case but, in 3+ years of developing LLM backed solutions, it's the first time I've had to reach for it.

[ Parent | on HN ]