Re:It is possible to detect and block Chrome headless
by psandersen on Thursday January 18, 2018 @09:08AM
(#16177081)
Just randomize the content they're trying the scrape imho
[ Parent
| on HN ]
Re:It is possible to detect and block Chrome headless
by dx034 on Thursday January 18, 2018 @10:07AM
(#16177576)
I saw that with a page and it works extremely well. Inserting wrong data based on rules (there it was on rate limiting rather than user agent) is extremely hard to detect. The scraper never knows if they see real or wrong data.
On the other hand, this will also get wrong data in search engines.
Re:It is possible to detect and block Chrome headless
by imtringued on Friday January 19, 2018 @07:12AM
(#16185610)
I think you could get pretty far just by simply scrambling the CSS classes and ids.