News for hackers. Stuff that matters.
Re:Faiss: Facebook's open source vector search library by Kydlaw on Tuesday December 14, 2021 @04:51PM (#29558434)
There is a lot done vector search technology right now. I was less fortunate when looking at ways to store the vectors in databases. I already looked at Pinecone or Weaviate but they are all paid products.

Is there some people having feedback on this?

Re:Faiss: Facebook's open source vector search library by lmeyerov on Tuesday December 14, 2021 @05:37PM (#29559089)
A lot of VCs & founders trying to commercialize other people's SW are wondering this too :)

AFAICT: Most of those are basically UIs, data management, & integrations around the same set of vector index libs like FAISS + same set of models like HF, and even the same set of inference server libs (triton, aws/gcp, fastapi, ...). So you'd be evaluating different commercializations of the same core OSS tech. There are useful evaluations to do at that level, but more like licensing, business model, UI, model management, etc.

Another commenter below recognized that regular DBs (ES, Postgres, ..) are starting to add vector indexes. As someone doing a lot of architecting for log/event/graph correlation/investigation systems, I've been tracking whether managed neural search db is a feature vs new category, and how big. Ex: those corporate sides definitely feels like an Algolia competitor, but for the 99% case we normally do, maybe just an OSS feature/lib of whatever DB/framework you're already using? Not obvious!

Re:Faiss: Facebook's open source vector search library by kateshao0510 on Wednesday December 15, 2021 @01:59AM (#29562899)
Another option is Milvus:https://github.com/milvus-io. It's an open-source vector database.
Re:Faiss: Facebook's open source vector search library by forgotmyoldacc on Wednesday December 15, 2021 @02:20AM (#29562987)
Milvus is a layer on top of FAISS.
Re:Faiss: Facebook's open source vector search library by gk1 on Tuesday December 14, 2021 @06:41PM (#29559732)
I don’t know when you last looked but as of a few months ago Pinecone has a free tier that fits 1M items with <100ms latency.
Re:Faiss: Facebook's open source vector search library by homarp on Wednesday December 15, 2021 @02:20AM (#29562992)