Re:Using Your Vector Database as a JSON (Or Relational) Data...
by w1 on Tuesday April 23, 2024 @12:21AM
(#40128473)
Postgres (with pgvector) is an unbelievably goated vector db. Idk why anyone would use anything else.
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by stephen37 on Tuesday April 23, 2024 @03:50AM
(#40129576)
It's nice to begin with but you usually quickly hit a scale issue from what I tried and talked to different people using it.
Also they only offer index stored in Memory as far as I know, also lack the support of different index or more advanced ones like GPU index.
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by brigadier132 on Tuesday April 23, 2024 @01:57AM
(#40128946)
PgVector stores the index in memory right? Do you really want your primary db using all its memory for vectors and all its cpu for doing vector dot products?
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by Bella-Xiang on Tuesday April 23, 2024 @01:48AM
(#40128902)
There are significant differences in performance, accuracy, and other aspects when using a general-purpose database like PostgreSQL. These differences can lead to bottlenecks in performance and data scale. You can refer to this comparison article to learn more
https://myscale.com/blog/myscale-vs-postgres-opensearch/
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by trosterud on Tuesday April 23, 2024 @07:12AM
(#40130518)
And Datomic is the goat outside of vectors
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by manishsharan on Tuesday April 23, 2024 @09:37AM
(#40131824)
So you want to run mission critical workloads on Postgres and do a vector similarity search on the same DB?
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by jurip on Tuesday April 23, 2024 @01:28AM
(#40128796)
"More complex workloads such as joins". How far we have fallen.
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by esafak on Tuesday April 23, 2024 @01:32AM
(#40128818)
You joke, but you would not blame redis for not doing joins. Vector databases are really more like caches that do similarity search. Maybe we should call them vector stores.
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by flawsofar on Tuesday April 23, 2024 @03:03AM
(#40129319)
I can see uses for joining vector queries. Give me all the people who are attracted to people like this one. Boom, embedded.
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by esafak on Wednesday April 24, 2024 @11:59AM
(#40145958)
> Give me all the people who are attracted to people like this one
This can be handled with a simple batch query rather than a join, even if you want to query for multiple users, fetching all of their related users. In qdrant, for example: https://qdrant.tech/blog/batch-vector-search-with-qdrant/
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by Culonavirus on Tuesday April 23, 2024 @05:39AM
(#40130174)
This is what gets me more and more with LLMs and their "ability to code". A join is a bedrock of a database. Always has been. Always will be. All LLMs are an absolute shitshow when it comes to any SQL logic involving joins. It's hilariously bad. But what can I expect from an LLM when apparently even people consider a JOIN a "more complex workload"? What a joke.
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by sgarland on Tuesday April 23, 2024 @08:06AM
(#40130974)
Eh? SQL is one area where I’ve found LLMs – at least, ChatGPT – to be surprisingly decent. I’ve even had it translate relational algebra back and forth.
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by randomdata on Tuesday April 23, 2024 @09:41AM
(#40131868)
Obviously it is a more complex workload. Consider a simple database like a hash map. Accessing one record in that map is easy, but it should be quite apparent that you need quite a bit more logic if you want to join that record with other records.
And that's not far off how current generation vector stores are implemented. They are not designed for efficient joins (nor aggregations) and changing that, like above, does require a more complex workload.
There is no free lunch in engineering, just a choice in which trade-offs you are willing to pay for.
> we've seen many companies and organizations hop on the vector search bandwagon, from NoSQL database providers such as MongoDB (via Atlas Vector Search) to traditional relational databases such as Postgres (via pgvector). The general messaging I hear around these vector search plugins is largely the same and goes something like this: developers should stick with us since you can store tables/JSON in addition to vectors, so there is no need to manage multiple pieces of infrastructure!
> This kind of statement always cracks me up, as it's clearly crafted by unsophisticated marketing teams
From the conclusion:
> Once your application starts requiring more complex workloads (such as joins or aggregations), that's when you'll want to contemplate using different data stores.
I don’t know, after reading through the post I’ve come away on the side of the “unsophisticated marketing teams”; if the vector DB doesn’t have transactions, joins, aggregations it sounds like I’d hit its limitations pretty quick and then I’d rather have an all-in-one industrial strength DB like Postgres instead of two systems.