Re:10 petabytes - visualized
by rphlx on Saturday January 15, 2011 @02:51PM
(#2107638)
I wonder how many thousands of people are paying them to back up stuff they could easily redownload. Great business model if they de-dupe internally.
[ Parent
| on HN ]
Re:10 petabytes - visualized
by sliverstorm on Saturday January 15, 2011 @06:55PM
(#2108150)
If you're implying they are crazy for doing so, have you ever lost everything and tried to redownload it all? It's a huge timesink, I tell you.
As for de-duping, Dropbox does this. When you drop a Windows ISO or the Office installer into your folder, it hashes the file and realizes 'hey we already have this!' and you don't have to upload it.
they encrypt all data and i dont think it would be wise of them analyzing their clients data for dupes...if somebody would get to know that their business would be gone.
Re:10 petabytes - visualized
by jodrellblank on Saturday January 15, 2011 @11:29PM
(#2108658)
ZFS supports encryption with deduplication, and Dropbox does dedupe accross customers (and why not? It's not a human digging through things).
http://blogs.sun.com/darren/entry/compress_encrypt_checksum_... - ZFS link
When different customers use different key to encrypt the data, even if the source is the same, the outcome is different. So it is not feasible to do de-duplication across different customers' data, unless all of them use the same key.