News for hackers. Stuff that matters.
Re:Avoiding bot detection: How to scrape the web without get... by Lukabuz on Sunday October 31, 2021 @10:14PM (#29062431)
If I am correct in assuming the parent is talking about puppeteer, there is a plugin[1] that claims to evade most of the methods used to detect headless browsers. I have used it recently for just that purpose, and I can say that it worked wifh minimal setup and configuration for my usecase, but I guess depending on the detection mechanisms youre evading YMMV.

The creator of that plugin does mention it is very much a cat and mouse game, just like most of the “scraping industry”

https://www.npmjs.com/package/puppeteer-extra-plugin-stealth

There are no comments on this comment yet.