The Geocities Torrent (~1TB of awesomeness)

Re:The Geocities Torrent (~1TB of awesomeness) by jacquesm on Wednesday October 27, 2010 @10:21PM (#1841432)

I have a large database table that stores the md5 hashes of all the files and there is a script that can compare all of the contents of the site with the hashes in the files (and with a second copy if that's what it would come to).

Some bitrot is inevitable but I think it's under control for now.

As for help, yes, but right now I'm pretty swamped in other stuff, the next round of work on reocities will likely come after the new year.

[ Parent | on HN ]

Re:The Geocities Torrent (~1TB of awesomeness) by daeken on Wednesday October 27, 2010 @10:32PM (#1841454)

Have you considered using something like MogileFS? It'd be perfect for this sort of situation.

Let me know if you're interested in this or have any questions -- I've dealt a good bit with systems like this in the past, and would love to give you a hand.

[ Parent | on HN ]

Re:The Geocities Torrent (~1TB of awesomeness) by jacquesm on Wednesday October 27, 2010 @11:17PM (#1841551)

You know where to find me :)

And yes, of course I'm interested. But right now no time.

[ Parent | on HN ]