But it would be because 1) they probably don't have many duped objects to begin with 2) the system to de-dupe items would be complex, error prone, increase latency, and just not worth it
That's crap reasoning. You have no way of knowing that.
> 2) the system to de-dupe items would be complex, error prone, increase latency, and just not worth
Would it really be that complex? I kinda doubt that.
Read latencies wouldn't be affected - except being improved.
Write latencies - the deduplication can happen after the write has been confirmed, so no extra latency added.
Whether or not it's worth it - I think it's very hard to to estimate the deduplication factor. My guess is 1.5x. At that point it would save 33% storage. That would instanly make a whole lot of extra complexity worth it.
I dunno, I kinda think you might be out of your depth on this one, based on that response.
Also: none of your few previous posts are tech-related. They're all about personal finance.