News for hackers. Stuff that matters.
Re:A Comprehensive Guide for Building Rag-Based LLM Applicat... by Tostino on Thursday September 14, 2023 @06:52PM (#37515865)
People seem to underestimate the scale you can get to on a single machine, and overestimate how easy it will be to go up from there.

An in memory index is about as good as it gets for a single node performance, and fitting that many vectors into memory on a single machine is easy.

There are no comments on this comment yet.