News for hackers. Stuff that matters.

A comment on Ask HN: Can I get in trouble for crawling using the Googlebot user agent?. Parent comment

Re:Ask HN: Can I get in trouble for crawling using the Googl... by jdavis703 on Friday April 21, 2017 @01:17PM (#14167421)
It might be against the terms of service of the website you're crawling, which puts you in violation of the Computer Fraud and Abuse Act (i.e. you're considered to be "hacking" them).
[ Parent | on HN ]
Re:Ask HN: Can I get in trouble for crawling using the Googl... by tomsmeding on Friday April 21, 2017 @01:28PM (#14167495)
Maybe that's called "hacking" in the relevant document, but I'd classify that as overly broad.
[ Parent | on HN ]
Re:Ask HN: Can I get in trouble for crawling using the Googl... by jdavis703 on Friday April 21, 2017 @01:41PM (#14167595)
Well however you classify it doesn't matter, what matters is how the government classifies it. There's the tragic story of Aaron Swartz who was caught up in this non-sense: https://en.wikipedia.org/wiki/Aaron_Swartz.
[ Parent | on HN ]