News for hackers. Stuff that matters.

A comment on Show HN: Epsilla – Open-source vector database with low query latency.

Re:Show HN: Epsilla – Open-source vector database with low q... by itake on Monday August 14, 2023 @02:15PM (#37124499)
imho, vectorDbs need to scale horizontally. Simply running on a single host doesn't cut it anymore.
[ Parent | on HN ]
Re:Show HN: Epsilla – Open-source vector database with low q... by songrenchu on Monday August 14, 2023 @03:31PM (#37125699)
You are right. We designed our storage in a segment-based way, with configurable segment size, so it can horizontally scale in the future cross multiple workers in one machine, and cross multiple machine cluster. And the search will become a two-stage search: find top K in each segment, then a global merger (can also be horizontally scaled) to merge the results from all segments
[ Parent | on HN ]