Re:3Taps Files Countersuit, Says Craigslist Is Anticompetitive
by jcampbell1 on Monday September 24, 2012 @11:06PM
(#4568338)
> You are not entitled to scrape content from other sites, even if they contain publicly submitted data.
Isn't this Google's business model? They take snapshots of the public web and show organized and relevant snippets. Last time I checked, they never asked me for permission.
Re:3Taps Files Countersuit, Says Craigslist Is Anticompetitive
by nhebb on Monday September 24, 2012 @11:26PM
(#4568410)
They don't ask your permission, but they do respect robots.txt files as well as noindex, nofollow.
Re:3Taps Files Countersuit, Says Craigslist Is Anticompetitive
by jcampbell1 on Monday September 24, 2012 @11:47PM
(#4568468)
I am sure the orignal author does as well. This is more a question of "fair use", not robots.txt
Re:3Taps Files Countersuit, Says Craigslist Is Anticompetitive
by chii on Tuesday September 25, 2012 @12:35AM
(#4568587)
Indeed - and i believe scraping data off a publically accessible webpage (e.g., one where you do not require registration and login/password) falls under fair use, provided you do not take up more bandwidth/resources than the average user of that site.
I recall there being some precedent for this sort of fair use - something like a phone directory - the information is not copyrighted, but the arrangement and layout is. So hence, you can't just iframe a site and present it, but obtaining the data, and deriving a new work from it should fall under fair use.
You have zero control over what you are selling to people. They don't know that you aren't using an offical means to get the data and the application could stop working at any time. And if you were scraping via the client (as opposed to collating data on a server of your own) you also put your customers in a position where they might be violating the site's TOS and risk reprecussions (ip ban, etc).