dryja
Re:Show HN: Cloakbits - Headless web scraping with bypass for anti-bot...
on Saturday January 09, 2021 @11:37AM (#25701781)
We regularly scrape competitor websites to get insights on product availability and pricing. However, one of the competitors installed a script that gets us "Pardon our interruption". I guess it's because of bot detection. Unfortunately, that puppeteer plugin doesn't make it any different. We overcome this by using Oxylabs service. It's pricey but as long as you don't mind paying extra bucks (& got low frequency of scraping) you can use it as an alternative.
Re:Show HN: FlightList – Find cheap, one-way flights within a departur...
on Monday August 27, 2018 @01:56PM (#17853042)
I may have spotted a bug. I am choosing Warsaw Chopin Airport (WAW) as a departure, but it shows results from WMI too :/