News for hackers. Stuff that matters.
Re:Geocities - "Under Construction" gif archive by zandorg on Tuesday October 13, 2009 @12:40PM (#879438)
On the topic of Geocities shutting down, I found an option in wget which ignores existing files - because Yahoo has a 503 error if you try to spider too many pages.

It's -nc which means 'no clobber' - which is the least helpful phrase considering you could say 'ignore existing'...

When you get a 503, wait about an hour, and then run wget until it fails, then wait an hour, etc, until you've got all 10mb of your webspace.

Also -np to only spider below your page on Geocities.

Re:Geocities - "Under Construction" gif archive by thwarted on Tuesday October 13, 2009 @01:59PM (#879641)
"no clobber" matches the shell option of the same name.