News for hackers. Stuff that matters.
Re:Ask HN: Review my web app, CraigUpdate.com by synnik on Friday July 17, 2009 @03:58PM (#710654)
I've noted, over the years, many sites that scrape craigslist data for one purpose or another. They run for a few months, get popular, get noticed by craigslist, get shut down.

Do you have ongoing communications with them to avoid this fate?

Re:Ask HN: Review my web app, CraigUpdate.com by weaksauce on Friday July 17, 2009 @05:02PM (#710783)
From the TOU: http://www.craigslist.org/about/terms.of.use

u) use automated means, including spiders, robots, crawlers, data mining tools, or the like to download data from the Service - unless expressly permitted by craigslist;

If you are serious about this site and you think that it could become a largish site you should definitely get permission.

Re:Ask HN: Review my web app, CraigUpdate.com by bluefish on Friday July 17, 2009 @04:07PM (#710672)
Agreed. You really need to read the CL TOS and make sure you're working with CL to use their data.
Re:Ask HN: Review my web app, CraigUpdate.com by andrewljohnson on Friday July 17, 2009 @04:18PM (#710695)
Could you name an example of this? I scraped CL for a while and they didn't say a word, and I've never heard of them shutting someone down.
Re:Ask HN: Review my web app, CraigUpdate.com by catone on Friday July 17, 2009 @05:06PM (#710792)
If you visit http://crgslst.com/ -- a multi-city search site -- it pops up a message about how they were blocked.

They also disabled Jeff Atwood's multi-city search: http://www.codinghorror.com/craigslist/ (he posted the letter he got from them)

Then again, http://www.housingmaps.com/ is still functional, and might be the most popular Craigslist mashup -- I'm assuming they have a deal in place with CL.

Re:Ask HN: Review my web app, CraigUpdate.com by nuggien on Friday July 17, 2009 @04:32PM (#710725)
how popular is your site? I remember they shut down some real estate site that mashed up craiglist data with google maps that got shut down pretty quickly. Not sure what the name was.