News for hackers. Stuff that matters.

A comment on Yahoo is Shutting Down Del.icio.us. Parent comment

Re:Yahoo is Shutting Down Del.icio.us by ryanwaggoner on Thursday December 16, 2010 @05:28PM (#2014080)
It's public data! You could scrape and index it now for free if you wanted...
[ Parent | on HN ]
Re:Yahoo is Shutting Down Del.icio.us by scorpion032 on Friday December 17, 2010 @05:04AM (#2015783)
They even throttle the friendfeed scraper which graciously pulls all its users data at once.

You can't write a simple scraper that is not distributed in 100 of machines across the web to pull out their data.

[ Parent | on HN ]
Re:Yahoo is Shutting Down Del.icio.us by viraptor on Friday December 17, 2010 @10:51AM (#2016552)
I heard that there is this thing called "the cloud" where you can rent services based on the work time. That makes cheapo servers both realistic and quite simple ;)

Actually I just noticed you get 750h of free micro instance time from aws... I wonder if it would be worth doing. I imagine the link+tags are <100GB in total.

[ Parent | on HN ]
Re:Yahoo is Shutting Down Del.icio.us by petercooper on Thursday December 16, 2010 @07:20PM (#2014521)
Though I've noticed only pages up to 200 work when going back through history.. this only gets you a few days back on the most popular tags.
[ Parent | on HN ]
Re:Yahoo is Shutting Down Del.icio.us by mikeklaas on Thursday December 16, 2010 @09:50PM (#2014941)
Sure, but user pages go back farther than that...
[ Parent | on HN ]
Re:Yahoo is Shutting Down Del.icio.us by bootload on Thursday December 16, 2010 @06:18PM (#2014318)
"... It's public data! You could scrape and index it now for free ..."

That is the most insightful thing I've read today.

[ Parent | on HN ]