Mega, the new MegaUpload, to launch on January 19

Re:Mega, the new MegaUpload, to launch on January 19 by marios on Thursday January 17, 2013 @10:32AM (#5073150)

You can do deduplication on chunks of the file. AFAIK, this is what cyphertite[1] does. Split each file in 256KB chunks, store their checksum and match those against a db do avoid resending / copying the same data over and over again.

I haven't tested cyphertite, but I've been meaning too. I mean, Ryan McBride is involved in the project as well as other OpenBSD devs. I'm hoping it has the same level of polish as OpenBSD.

[1] https://www.cyphertite.com/

[ Parent | on HN ]

Re:Mega, the new MegaUpload, to launch on January 19 by bgaluszka on Thursday January 17, 2013 @02:41PM (#5074716)

Tarsnap [1] does that too.

[1] http://www.tarsnap.com/

[ Parent | on HN ]

Re:Mega, the new MegaUpload, to launch on January 19 by BrokenPipe on Thursday January 17, 2013 @10:36AM (#5073172)

thanks for the link, interesting.

[ Parent | on HN ]