News for hackers. Stuff that matters.

A comment on Ask HN: Is scraping webpages for research purposes considered legal.

Re:Ask HN: Is scraping webpages for research purposes consid... by viraptor on Thursday July 05, 2018 @06:44AM (#17462186)
Depends on a country. And in practice on how much money the people behind the website can throw at the lawyers when annoyed.

For the US you may want to read about https://en.wikipedia.org/wiki/Aaron_Swartz

[ Parent | on HN ]
Re:Ask HN: Is scraping webpages for research purposes consid... by Petrakis on Thursday July 05, 2018 @06:56AM (#17462251)
Also depends on the ToS of each page, and their robots.txt should allow or disallow crawling
[ Parent | on HN ]