News for hackers. Stuff that matters.

A comment on Will Amazon S3 Vectors Kill Vector Databases–Or Save Them?. Parent comment

Re:Will Amazon S3 Vectors Kill Vector Databases–Or Save Them? by cyberax on Tuesday September 09, 2025 @01:24AM (#45177723)
A tool to look at hot partitions, for one thing.
[ Parent | on HN ]
Re:Will Amazon S3 Vectors Kill Vector Databases–Or Save Them? by JustExAWS on Tuesday September 09, 2025 @10:29AM (#45182438)
It should handle that automatically

https://aws.amazon.com/blogs/database/part-2-scaling-dynamod...

[ Parent | on HN ]
Re:Will Amazon S3 Vectors Kill Vector Databases–Or Save Them? by cyberax on Tuesday September 09, 2025 @02:47PM (#45186727)
The keyword here is "should" :) Back then DynamoDB also had a problem with scaling the data can be easily split into partitions, but it's never merged back into fewer partitions.

So if you scaled up and then down, you might have ended with a lot of partitions that got only a few IOPS quota each. It's better now with burst IOPS, but it still is a problem sometimes.

[ Parent | on HN ]