“Starting February 9, we will no longer support free access to the Twitter API”

Re:“Starting February 9, we will no longer support free acce... by tzs on Friday February 03, 2023 @04:55PM (#34648273)

Twitter could add anti-bot protection like Cloudflare’s CAPTCHA. I’ve seen that make a site unusable with Puppeteer. By “unusable” I mean that correctly solving the CAPTCHA either just gives you another CAPTCHA, or gives the “click if you are human” thing, and clicking that just goes to a CAPTCHA or another “click if you are human”.

It didn’t even require doing anything to/on the page with Puppeteer. Merely using it to open a browser window and then waiting, and using that browser window by hand during the wait to go visit the site that was using Cloudflare anti-bot protection ran into the problem.

[ Parent | on HN ]

Re:“Starting February 9, we will no longer support free acce... by theturtletalks on Friday February 03, 2023 @06:27PM (#34649316)

I actually face the same issue on Firefox with some websites except I’m not using Puppeteer. I thought it was a glitch with Cloudflare but guess not.

[ Parent | on HN ]

Re:“Starting February 9, we will no longer support free acce... by numpad0 on Friday February 03, 2023 @09:42PM (#34650834)

IIRC, puppeteer/webdriver things generally work by injecting JS through extension, and their presence can be detected by looking for those objects/functions from JS.

[ Parent | on HN ]

Re:“Starting February 9, we will no longer support free acce... by theturtletalks on Friday February 03, 2023 @10:37PM (#34651195)

Isn’t there a stealth plugin that can hide the injected JavaScript?

[ Parent | on HN ]