News for hackers. Stuff that matters.
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by jasonkester on Thursday December 05, 2024 @01:45AM (#42325639)
In five pages of text, we never get to learn what a Vector is (in this context), why we’d want to store one in pgsql, or why it costs so much to store them compared to anything else you’d store there.

For an example of how you can communicate with domain experts, while still giving everyone else some form of clue as to what this hell you’re talking about, check out the link to the product that this thing claims to be a successor to:

https://pgvecto.rs/

That starts off by telling us what it is and what it does.

Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by lja on Thursday December 05, 2024 @03:38AM (#42326195)
That's because this product isn't for you then. My team has been evaluating vector databases for years and everything on the VectorChord page resonated with me. We run one of the world's largest vector databases and we'll likely benchmark vectorchord to see if it lives up to its promises here.
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by gaocegege on Thursday December 05, 2024 @03:47AM (#42326236)
Hi, we’re here to help if you need assistance (via GitHub issue, Discord, or email). Could you let us know the scale of your vectors—are they 1B or 10B?
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by lja on Thursday December 05, 2024 @04:01AM (#42326331)
10B, feel free to email me luke@ the domain in my profile.
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by thelittleone on Thursday December 05, 2024 @06:38AM (#42327175)
Do you have a blog per chance? Or any recommended reading on pre processing / data chunking strategies to improve results?
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by VoVAllen on Thursday December 05, 2024 @07:01AM (#42327318)
I recently came across a project that looks promising: [WordLlama](https://github.com/dleemiller/WordLlama?tab=readme-ov-file#s...). It appears to be well-suited for semantic chunking, though I haven’t had a chance to try it out yet.
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by redskyluan on Thursday December 05, 2024 @10:09AM (#42328926)
Maybe check this https://zilliz.com/pricing

Yan easily store 1B data into Zilliz Serverless and the cost is incredible cheap

Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by lja on Thursday December 05, 2024 @11:01AM (#42329399)
Zilliz gave us a near 6-figure a month quote for our database.
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by xieydd on Thursday December 05, 2024 @06:52PM (#42334236)
You cannot compare Serverless with dedicated instance, this is unfair. A large number of writes and queries will eat up your wallet.
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by redskyluan on Thursday December 05, 2024 @08:39PM (#42335170)
That's true. Now we can offer the new dedicated Cost-optimized CU,pricing is

$0.318/hour ($228.96/month)

Which means you can store 20M 768 dimension data in 228$ per month

Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by curl-up on Thursday December 05, 2024 @03:44AM (#42326225)
So they should start every one of their posts, on that same site, with a summary of what is available on the homepage?
Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by jasonkester on Thursday December 05, 2024 @11:16AM (#42329524)
Wow. It never occurred to me that this might be anything but the landing page of a product.

The title here, the presentation on the page itself. Everything screams "landing page". I had to go back on a desktop browser to see the word "blog" in the url bar, and mentally shift those graphics and little islands of text around until I can view it from that lens. If it's really just a sub-product of the main product that they're talking about, then yeah, it makes more sense in that context.

But my answer to your question would still be "Yes". Absolutely. If you're a product, the job of your blog is to convince people coming off the street that they need your thing, even if they didn't realize it yet.

Step one of that process is to not bounce them back to the street without any idea what they're looking at.

Re:VectorChord: Store 400k Vectors for $1 in PostgreSQL by Raed667 on Thursday December 05, 2024 @05:23AM (#42326741)
And every hosting provider doesn't start by teaching you what is HTML