News for hackers. Stuff that matters.

A comment on Twitter now requires an account to view tweets. Parent comment

Re:Twitter now requires an account to view tweets by nirui on Saturday July 01, 2023 @04:06AM (#36547862)
Unless the captcha is annoying enough to a significant degrees, I doubt that it would work. With all the money in the bucket, scrapers can just hire a captcha farm to get pass the captcha with help from a real human.

Also a side note: distributed Web crawler is not unheard of these days, as well as residential IP proxies. Meaning the effectiveness of Proof of Work model maybe also limited.

[ Parent | on HN ]
Re:Twitter now requires an account to view tweets by yuuuuuuuu on Saturday July 01, 2023 @10:59AM (#36550820)
How do residential proxies help? Scraping would effectively be bitcoin mining, which costs resources without shortcut.
[ Parent | on HN ]
Re:Twitter now requires an account to view tweets by nirui on Saturday July 01, 2023 @11:01PM (#36557791)
Many online services (including Twitter) do employ some kind of IP address scoring system as part of their anti-scraping effort.

These systems tend to treat residential proxies as normal users, and puts less restrictions on them. On the other hand, if the IP address belongs to some (untrusted) IDCs, then the system will enable more annoying restrictions (say rate limits etc) against it, making scraping less efficient.

[ Parent | on HN ]