News for hackers. Stuff that matters.

A comment on Twitter now requires an account to view tweets. Parent comment

Re:Twitter now requires an account to view tweets by m00x on Saturday July 01, 2023 @07:50AM (#36549118)
FWIW: I've been scraping the shit out of social media for my AI training. I also do Amazon, AliExpress, etc.

Libs like puppeteer is so good these days that it's impossible to tell real users from fake traffic. Most of the blocks are just IP blocks.

[ Parent | on HN ]
Re:Twitter now requires an account to view tweets by qingcharles on Saturday July 01, 2023 @11:53AM (#36551420)
Right. And the IP blocks only add a small cost to the scraping because it forces people to use residential IPs which can't sanely be blocked.
[ Parent | on HN ]