News for hackers. Stuff that matters.
Re:Ask HN: How do you feel about web scraping? by wslh on Tuesday June 06, 2017 @07:57PM (#14502601)
I am not sure you can define those terms in a formal way. You can crawl the data in some way but use it for many different purposes that are difficult to control.
Re:Ask HN: How do you feel about web scraping? by ellimilial on Wednesday June 07, 2017 @04:25AM (#14504553)
Fancy extension to robots.txt?