Re:Using Your Vector Database as a JSON (Or Relational) Data...
by Culonavirus on Tuesday April 23, 2024 @05:39AM
(#40130174)
This is what gets me more and more with LLMs and their "ability to code". A join is a bedrock of a database. Always has been. Always will be. All LLMs are an absolute shitshow when it comes to any SQL logic involving joins. It's hilariously bad. But what can I expect from an LLM when apparently even people consider a JOIN a "more complex workload"? What a joke.
[ Parent
| on HN ]
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by sgarland on Tuesday April 23, 2024 @08:06AM
(#40130974)
Eh? SQL is one area where I’ve found LLMs – at least, ChatGPT – to be surprisingly decent. I’ve even had it translate relational algebra back and forth.
Re:Using Your Vector Database as a JSON (Or Relational) Data...
by randomdata on Tuesday April 23, 2024 @09:41AM
(#40131868)
Obviously it is a more complex workload. Consider a simple database like a hash map. Accessing one record in that map is easy, but it should be quite apparent that you need quite a bit more logic if you want to join that record with other records.
And that's not far off how current generation vector stores are implemented. They are not designed for efficient joins (nor aggregations) and changing that, like above, does require a more complex workload.
There is no free lunch in engineering, just a choice in which trade-offs you are willing to pay for.