A Week of Mining Seattle’s Craigslist Apartment Pricing

Re:A Week of Mining Seattle’s Craigslist Apartment Pricing by dave5104 on Thursday May 14, 2015 @11:41AM (#9545771)

I'm curious about this too, especially since OP says they'd like to continue scraping. I've heard of other people crawling craigslist getting banned pretty fast and even one site getting slapped with a lawsuit [0]. (Which looks like was not entirely successful for craigslist.)

Craigslist has even taken some measures to get their users to assign copyright of the content over to craigslist themselves [1].

[0] http://venturebeat.com/2013/05/01/padmapper-craigslist-3taps... [1] http://www.on-site.com/what-you-need-to-know-about-craigslis...

[ Parent | on HN ]

Re:A Week of Mining Seattle’s Craigslist Apartment Pricing by racketracer on Thursday May 14, 2015 @01:34PM (#9546364)

I scraped it probably at least 50 times and nothing has happened. I heard that craigslist only blocks IPs that direct a lot of traffic toward their sites like Padmapper did.

[ Parent | on HN ]