News for hackers. Stuff that matters.
Re:Choosing vector database: a side-by-side comparison by dmezzetti on Wednesday October 04, 2023 @11:53AM (#37766994)
I'll add txtai to the list: https://github.com/neuml/txtai

txtai is an all-in-one embeddings database for semantic search, LLM orchestration and language model workflows.

Embeddings databases are a union of vector indexes (sparse and dense), graph networks and relational databases. This enables vector search with SQL, topic modeling and retrieval augmented generation.

txtai adopts a local-first approach. A production-ready instance can be run locally within a single Python instance. It can also scale out when needed.

txtai can use Faiss, Hnswlib or Annoy as it's vector index backend. This is relevant in terms of the ANN-Benchmarks scores.

Disclaimer: I am the author of txtai

Re:Choosing vector database: a side-by-side comparison by emilfroberg on Wednesday October 04, 2023 @01:44PM (#37768888)
Txtai looks interesting, maybe you could help me collect some of the comparision parameters for it?
Re:Choosing vector database: a side-by-side comparison by dmezzetti on Wednesday October 04, 2023 @02:02PM (#37769156)
Sure, I'd be happy to do so. Easiest way is probably using the public Slack channel that's accessible via the GitHub page.
Re:Choosing vector database: a side-by-side comparison by Der_Einzige on Wednesday October 04, 2023 @07:19PM (#37773038)
I know David and have used txtai extensively. txtai is awesome and if you care at all about open source, you should give it a shot!
Re:Choosing vector database: a side-by-side comparison by dmezzetti on Thursday October 05, 2023 @07:03AM (#37777069)
Thank you!