News for hackers. Stuff that matters.
Re:Blocked by Cloudflare by sam0x17 on Wednesday August 09, 2023 @12:43AM (#37058787)
Furthermore, all bots worth their salt as far as threats go enable js and do everything they can to appear like a normal browser.
Re:Blocked by Cloudflare by azalemeth on Wednesday August 09, 2023 @03:34AM (#37059682)
I'd love to know if puppeteer passed that test (probably). I have had exactly this problem many, many times and it is incredibly frustrating.
Re:Blocked by Cloudflare by 20after4 on Thursday August 10, 2023 @05:21AM (#37073817)
puppeteer passes the test if you run it from a machine that already has a good cloudflare reputation score. Try it from an AWS instance and it definitely fails 100% of the time.

(I've tried it, that's how I know)

Re:Blocked by Cloudflare by sam0x17 on Monday August 14, 2023 @01:27PM (#37123811)
There are github projects that are forks of things like selenium and puppeteer that are specifically designed to avoid detection for things like scraping google search results, etc.
Re:Blocked by Cloudflare by tick_tock_tick on Wednesday August 09, 2023 @05:35AM (#37060420)
That's fine as processing the javascript increases the coast at-least.