Re:Lessons learned using single-table design with DynamoDB a...
by haolez on Saturday November 30, 2019 @03:14PM
(#21671926)
I think this doesn’t apply to Global Secondary Indexes, but I might be wrong.
Re:Lessons learned using single-table design with DynamoDB a...
by erik_seaberg on Saturday November 30, 2019 @04:20PM
(#21672209)
Yeah, partition size is only limited if you create a local index, because those are strongly consistent.
Re:Lessons learned using single-table design with DynamoDB a...
by delive on Saturday November 30, 2019 @04:59PM
(#21672377)
Ah interesting, it looks like you are right. If the any partition grows to > 10GB on the main table or a GSI, that partition splits into sub-partitions using the sort key as part of the hashing function. If there is no sort key, the partitioning scheme equally distributes items across partitions, so all partitions sub-divide at the same time.
https://stackoverflow.com/questions/40272600/is-there-a-dyna...
Re:Lessons learned using single-table design with DynamoDB a...
by ro_sharp on Sunday December 01, 2019 @01:36AM
(#21674199)
Couldn’t this still hit partition throughput limits though?
Re:Lessons learned using single-table design with DynamoDB a...
by erik_seaberg on Sunday December 01, 2019 @04:11AM
(#21674644)
It's pretty opaque. My impression is that each shard (storage backend quorum) gets a roughly equal share of capacity you pay for, and items in the same partition tend to live on the same shard to keep range queries small (and local indices require one-shard partitions). They've made improvements in loaning cold shards' unused capacity to hot shards, but they still recommend avoiding hot partitions and keeping load roughly even.
Re:Lessons learned using single-table design with DynamoDB a...
by yodon on Saturday November 30, 2019 @02:25PM
(#21671698)
Just as an FYI, when you use code formatting for text it makes the text unreadable on mobile devices.
Won't this cause problems with having every item of a type on a single node in AWS since the hash keys are the same? Or, are they suggesting that on the GSI they use KEYS_ONLY, and even though every item lives on one node, the size of all are only the keys (even so, I don't see how that's very useful short of counting number of items).