Re:Ask HN: What info do you web scrape for?
by vijayr on Monday August 11, 2014 @01:00PM
(#8164065)
What about legal implications? Do you get permission from the sites you crawl?
[ Parent
| on HN ]
Re:Ask HN: What info do you web scrape for?
by frabcus on Monday August 11, 2014 @01:30PM
(#8164215)
Legality of scraping is a subtle issue - I wrote up my take on it here: https://blog.scraperwiki.com/2012/04/is-scraping-legal/
[deleted]
Thank you for answering. Though private and internal, you are still using the data for profit, is that correct? Does it mean that one can't sell the data, but can use it for analysis etc and still profit from it?
I saw a service recently that emails app store reviews/ratings for a fee. Not sure if they are scraping or getting the reviews some other way. The same idea can be extended to lots of things like Amazon reviews etc. Not sure of the legal stuff though.
Re:Ask HN: What info do you web scrape for?
by lumpypua on Monday August 11, 2014 @01:52PM
(#8164319)
I deleted it 'cause I'm not comfortable having those details online. An extremely long story short, in our domain we're using the scraped data exactly as the owners intend, albeit via machines instead of people. Consult a lawyer.