Re:It is not possible to detect and block Chrome headless
by jjeaff on Thursday January 18, 2018 @01:23PM
(#16179772)
That's old hat and ineffective. Scrapers usually proxy through large lists of rotating ip addresses. There are lots of services for it.
[ Parent
| on HN ]
Re:It is not possible to detect and block Chrome headless
by saas_co_de on Thursday January 18, 2018 @02:46PM
(#16180644)
depends. if you also do tracking for valid navigation paths then rate limiting may be effective.
For instance: if you have a search result with a 1000 pages that someone is trying to scrape if you don't allow people to jump into the middle of the result set then just rotating IPs doesn't work.