Re:How to scrape anything on the web and not get caught
by time0ut on Sunday April 22, 2018 @09:35AM
(#16896095)
I've used it to convert publicly available data to a more useful format. A local government agency made the data freely available as a series of thousands of HTML pages, but not in any other form. I didn't need to use any evasive tactics, but it was still wholesale repeated scraping.
[ Parent
| on HN ]
There are no comments on this comment yet.