Re:Avoiding bot detection: How to scrape the web without get...
by Lukabuz on Sunday October 31, 2021 @10:14PM
(#29062431)
If I am correct in assuming the parent is talking about puppeteer, there is a plugin[1] that claims to evade most of the methods used to detect headless browsers. I have used it recently for just that purpose, and I can say that it worked wifh minimal setup and configuration for my usecase, but I guess depending on the detection mechanisms youre evading YMMV.
The creator of that plugin does mention it is very much a cat and mouse game, just like most of the “scraping industry”
The creator of that plugin does mention it is very much a cat and mouse game, just like most of the “scraping industry”
https://www.npmjs.com/package/puppeteer-extra-plugin-stealth