Re:How to scrape anything on the web and not get caught
by pjc50 on Sunday April 22, 2018 @03:59AM
(#16895193)
The cheap technique is rate limiting, but there are also "canary pages" (linked invisibly but should not be accessed by humans) and other techniques for looking to see if the flow through the site is as expected.
[ Parent
| on HN ]
There are no comments on this comment yet.