News for hackers. Stuff that matters.
Re:Show HN: Cloakbits - Headless web scraping with bypass fo... by dryja on Saturday January 09, 2021 @11:37AM (#25701781)
We regularly scrape competitor websites to get insights on product availability and pricing. However, one of the competitors installed a script that gets us "Pardon our interruption". I guess it's because of bot detection. Unfortunately, that puppeteer plugin doesn't make it any different. We overcome this by using Oxylabs service. It's pricey but as long as you don't mind paying extra bucks (& got low frequency of scraping) you can use it as an alternative.

There are no comments on this comment yet.