News for hackers. Stuff that matters.

A comment on Web Scraping in 2016. Parent comment

Re:Web Scraping in 2016 by desireco42 on Wednesday August 24, 2016 @10:45AM (#12352391)
Google and others, with legitimate reasons obey robots.txt
[ Parent | on HN ]

There are no comments on this comment yet.