News for hackers. Stuff that matters.
Re:Priceonomics (YC W12) Tells You What Everything is Worth by ilamont on Thursday December 22, 2011 @09:48PM (#3384378)
How do startups get around the Craigslist TOU against using "automated means, including spiders, robots, crawlers, data mining tools, or the like to download data from the Service" (http://www.craigslist.org/about/terms.of.use)?
Re:Priceonomics (YC W12) Tells You What Everything is Worth by gms on Friday December 23, 2011 @12:48AM (#3384818)
They don't - it's a bit "don't ask, don't tell". The hope is that if Craigslist ever decides to enforce the TOU, said startup is popular enough that they can work out a deal.
Re:Priceonomics (YC W12) Tells You What Everything is Worth by paulhauggis on Thursday December 22, 2011 @09:51PM (#3384387)
I wondered the same. A guy was actually sued over this for his automated crawling/posting bots he was selling as a service. From what I've heard, their lawyers are pretty relentless.

I think he is also a reader on HN.

Re:Priceonomics (YC W12) Tells You What Everything is Worth by jpdoctor on Thursday December 22, 2011 @10:14PM (#3384458)
Don't the padmapper/etc housing crawlers do this?

Those are incredibly useful too, it is much easier to see those things on a map.

Re:Priceonomics (YC W12) Tells You What Everything is Worth by CoffeeDregs on Thursday December 22, 2011 @10:37PM (#3384507)
You don't crawl Craigslist; you tickle Google. Craigslist can't block them... But you'll still need an excellent lawyer...
Re:Priceonomics (YC W12) Tells You What Everything is Worth by slig on Friday December 23, 2011 @06:22AM (#3385390)
I thought Google was heavily against automated searches and blocked bots on spot.
Re:Priceonomics (YC W12) Tells You What Everything is Worth by binarysolo on Friday December 23, 2011 @08:18AM (#3385594)
I think a solution using RSS feeds may get around this, if you can have RSS feeds to everything. (Not super familiar with CL feeds.)