News for hackers. Stuff that matters.

A comment on Blocked by Cloudflare. Parent comment

Re:Blocked by Cloudflare by azalemeth on Wednesday August 09, 2023 @03:34AM (#37059682)
I'd love to know if puppeteer passed that test (probably). I have had exactly this problem many, many times and it is incredibly frustrating.
[ Parent | on HN ]
Re:Blocked by Cloudflare by 20after4 on Thursday August 10, 2023 @05:21AM (#37073817)
puppeteer passes the test if you run it from a machine that already has a good cloudflare reputation score. Try it from an AWS instance and it definitely fails 100% of the time.

(I've tried it, that's how I know)

[ Parent | on HN ]
Re:Blocked by Cloudflare by sam0x17 on Monday August 14, 2023 @01:27PM (#37123811)
There are github projects that are forks of things like selenium and puppeteer that are specifically designed to avoid detection for things like scraping google search results, etc.
[ Parent | on HN ]