News for hackers. Stuff that matters.

A comment on Delicious's Data Policy is Like Setting a Museum on Fire.

Re:Delicious's Data Policy is Like Setting a Museum on Fire by akshayubhat on Friday December 17, 2010 @11:14AM (#2016606)
I can only think of using 80legs as a crawler, since its distributed enough to make sure that you don't run into any IP address based rate limitation. But it's just a guess.
[ Parent | on HN ]
Re:Delicious's Data Policy is Like Setting a Museum on Fire by slig2 on Friday December 17, 2010 @11:33AM (#2016674)
You probably can't do it, because 80 respects robots.txt AFAIK.
[ Parent | on HN ]