Re:Priceonomics (YC W12) Tells You What Everything is Worth
by ilamont on Thursday December 22, 2011 @09:48PM
(#3384378)
How do startups get around the Craigslist TOU against using "automated means, including spiders, robots, crawlers, data mining tools, or the like to download data from the Service" (http://www.craigslist.org/about/terms.of.use)?
[ Parent
| on HN ]
Re:Priceonomics (YC W12) Tells You What Everything is Worth
by gms on Friday December 23, 2011 @12:48AM
(#3384818)
They don't - it's a bit "don't ask, don't tell". The hope is that if Craigslist ever decides to enforce the TOU, said startup is popular enough that they can work out a deal.
Re:Priceonomics (YC W12) Tells You What Everything is Worth
by paulhauggis on Thursday December 22, 2011 @09:51PM
(#3384387)
I wondered the same. A guy was actually sued over this for his automated crawling/posting bots he was selling as a service. From what I've heard, their lawyers are pretty relentless.
I think he is also a reader on HN.
Re:Priceonomics (YC W12) Tells You What Everything is Worth
by jpdoctor on Thursday December 22, 2011 @10:14PM
(#3384458)
Don't the padmapper/etc housing crawlers do this?
Those are incredibly useful too, it is much easier to see those things on a map.
Re:Priceonomics (YC W12) Tells You What Everything is Worth
by CoffeeDregs on Thursday December 22, 2011 @10:37PM
(#3384507)
You don't crawl Craigslist; you tickle Google. Craigslist can't block them... But you'll still need an excellent lawyer...
Re:Priceonomics (YC W12) Tells You What Everything is Worth
by slig on Friday December 23, 2011 @06:22AM
(#3385390)
I thought Google was heavily against automated searches and blocked bots on spot.
Re:Priceonomics (YC W12) Tells You What Everything is Worth
by binarysolo on Friday December 23, 2011 @08:18AM
(#3385594)
I think a solution using RSS feeds may get around this, if you can have RSS feeds to everything. (Not super familiar with CL feeds.)