News for hackers. Stuff that matters.
Re:What Is a Vector Database by imaurer on Friday May 05, 2023 @06:41AM (#35827504)
I am bullish Pgvector because I am “postgres for everything guy”.

Current concerns are the scaling and recall performance when looking at large amounts of records.

The author is looking at product quantization along with other ideas: https://github.com/pgvector/pgvector/issues/27

More details on product quantization: https://mccormickml.com/2017/10/13/product-quantizer-tutoria...

A nice repo that tracks the ANN relative performance of different indexes: https://mccormickml.com/2017/10/13/product-quantizer-tutoria...

Also shoutout to Weaviate because they have great docs, are open source and have very informative YouTube channel.

Re:What Is a Vector Database by mritchie712 on Friday May 05, 2023 @06:51AM (#35827591)
Yep, we're (https://www.definite.app/) using pgvector and I was initially concerned about scaling, but it doesn't seem it will be a problem for our use case. I definitely wouldn't use it if I was building a feature for Slack, but works for us!
Re:What Is a Vector Database by overview on Friday May 05, 2023 @08:35AM (#35828429)
At a glance, your product seems like a fit for my team. However, your landing page doesn’t give specifics. What exactly does it do?
Re:What Is a Vector Database by mritchie712 on Friday May 05, 2023 @10:26AM (#35829650)
Yes, working on that landing page right now (currently it's pretty week)!

We're building an AI data analyst. You can ask questions of your database and get answers immediately. We also auto generate entire dashboards based on common patterns (e.g. a "Sales Dashboard", "Marketing Dashboard", "Finance / Burn" etc.).

If you want to give it a try (there's a demo database embedded in the app), you can use it here: https://ui.definite.app/

Re:What Is a Vector Database by KyeRussell on Friday May 05, 2023 @07:09AM (#35827711)
Amen. After suffering through many years of people telling me to use document databases when I was much better served with—at most—Postgres with a jsonb field, I feel vindicated enough to feel justified in doing my due diligence before going off the beaten track.

Not that document databases don’t have their place, but…MongoDB is webscale and all that.

Re:What Is a Vector Database by akiselev on Friday May 05, 2023 @12:54PM (#35831965)
Obligatory Youtube video for historical purposes: https://www.youtube.com/watch?v=b2F-DItXtZs
Re:What Is a Vector Database by videlov on Friday May 05, 2023 @07:11AM (#35827725)
Over the past couple of days I tried 11 different vector databases, in order to evaluate and decide which one we'd choose for our use case.

I ended up choosing Weaviate specifically because of the nice docs, but beyond that, time will tell.

Re:What Is a Vector Database by technics256 on Friday May 05, 2023 @07:16AM (#35827765)
Curious if you tried Vespa?
Re:What Is a Vector Database by dunefox on Friday May 05, 2023 @08:29AM (#35828366)
Any thoughts on Milvus?
Re:What Is a Vector Database by canadiantim on Friday May 05, 2023 @08:49AM (#35828550)
Have you tried cozodb? Newest kid on the block, looks very promising
Re:What Is a Vector Database by mmaia on Friday May 05, 2023 @09:02AM (#35828684)
I would love to read more about your experience. We need more content with feature, peformance, and architecture comparisons. Currently, there's a lot of developer evangelism hype in the space.
Re:What Is a Vector Database by bobvanluijt on Friday May 05, 2023 @10:18AM (#35829562)
Thanks, that's nice feedback
Re:What Is a Vector Database by supriyo-biswas on Friday May 05, 2023 @07:12AM (#35827729)
Can you search both by an equality comparison and a vector search in weaviate? I’d like to do something along the lines of `SELECT * FROM table t WHERE cosine_dist(:my_embedding, t.doc_embedding) < :x AND some_column = “XYZ”`
Re:What Is a Vector Database by imaurer on Friday May 05, 2023 @08:57AM (#35828628)
Well Weaviate is graphql and it has filtering and hybrid search which is a great feature that pg can’t fully support because it doesn’t have bm25

https://weaviate.io/developers/weaviate/api/graphql/filters

https://weaviate.io/blog/hybrid-search-explained

I have a ChatGPT session where I have asked it to do a hybrid search using filtering, pg fts and vector search. Looks reasonable just need to test it and write it up somewhere.