Re:Twitter now requires an account to view tweets
by yuuuuuuuu on Saturday July 01, 2023 @10:59AM
(#36550820)
How do residential proxies help? Scraping would effectively be bitcoin mining, which costs resources without shortcut.
[ Parent
| on HN ]
Re:Twitter now requires an account to view tweets
by nirui on Saturday July 01, 2023 @11:01PM
(#36557791)
Many online services (including Twitter) do employ some kind of IP address scoring system as part of their anti-scraping effort.
These systems tend to treat residential proxies as normal users, and puts less restrictions on them. On the other hand, if the IP address belongs to some (untrusted) IDCs, then the system will enable more annoying restrictions (say rate limits etc) against it, making scraping less efficient.