So you wanna build a local RAG?

Re:So you wanna build a local RAG? by simonw on Friday November 28, 2025 @09:20PM (#46084715)

Yeah, that sounds about right to me. The most effective approach does appear to be a hybrid of embeddings and BM25, which is worth exploring if you have the capacity to do so.

For most cases though sticking with BM25 is likely to be "good enough" and a whole lot cheaper to build and run.

[ Parent | on HN ]

Re:So you wanna build a local RAG? by mips_avatar on Saturday November 29, 2025 @03:08AM (#46085882)

Depends on the app and how often you need to change your embeddings, but I run my own hybrid semantic/bm25 search on my MacBook Pro across millions of documents without too much trouble.

[ Parent | on HN ]

Re:So you wanna build a local RAG? by echion on Thursday December 11, 2025 @09:17PM (#46240140)

Can you elaborate a bit on your setup if you have time?

[ Parent | on HN ]