News for hackers. Stuff that matters.

A comment on Investing in new vector database development vs enhancing existing databases. Parent comment

Re:Investing in new vector database development vs enhancing... by dmezzetti on Sunday November 26, 2023 @12:00AM (#38419298)
txtai can use Postgres as a data store and combine that with a vector index like Faiss or Hnswlib.

In this case, you get the robustness of Postgres (which has been around a while) and Faiss (which is one of the most mature vector indexes).

https://neuml.hashnode.dev/external-database-integration

[ Parent | on HN ]
Re:Investing in new vector database development vs enhancing... by omneity on Sunday November 26, 2023 @10:55PM (#38427868)
txtai looks cool. Did you use it before in scenarios with all 4 components?

I’m curious about which use cases it enables.

[ Parent | on HN ]
Re:Investing in new vector database development vs enhancing... by dmezzetti on Monday November 27, 2023 @06:51AM (#38431211)
In case it wasn't clear, I'm the main author of txtai.

I use txtai in my everyday work. While txtai is open source, I also support a number of consulting projects that are txtai focused. In most cases, I've used SQLite + Faiss for the vector database config paired with an LLM for RAG support.

This setup has worked well and it's what I would start with until it didn't scale.

[ Parent | on HN ]