News for hackers. Stuff that matters.
Re:Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects by tpmx on Monday March 15, 2021 @05:46PM (#26469591)
> 1) they probably don't have many duped objects to begin with

That's crap reasoning. You have no way of knowing that.

> 2) the system to de-dupe items would be complex, error prone, increase latency, and just not worth

Would it really be that complex? I kinda doubt that.

Read latencies wouldn't be affected - except being improved.

Write latencies - the deduplication can happen after the write has been confirmed, so no extra latency added.

Whether or not it's worth it - I think it's very hard to to estimate the deduplication factor. My guess is 1.5x. At that point it would save 33% storage. That would instanly make a whole lot of extra complexity worth it.

Re:Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects by weird-eye-issue on Monday March 15, 2021 @06:05PM (#26469827)
It's like you are living in an alternate reality
Re:Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects by tpmx on Monday March 15, 2021 @06:17PM (#26469971)
...because?

I dunno, I kinda think you might be out of your depth on this one, based on that response.

Also: none of your few previous posts are tech-related. They're all about personal finance.

Re:Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects by weird-eye-issue on Monday March 15, 2021 @06:38PM (#26470215)
So just to sum up your argument: You think 33% of objects in S3 are dupes and that removing those dupes would be S3's secret sauce?
[dead]
Re:Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects by weird-eye-issue on Monday March 15, 2021 @07:11PM (#26470530)
You're incredibly condescending and just full of incorrect assumptions. Done with this conversation
Re:Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects by tpmx on Monday March 15, 2021 @07:11PM (#26470533)
...