Mimicking a device is becoming almost impossible

Re:Mimicking a device is becoming almost impossible by fukd on Monday June 28, 2021 @01:43PM (#27664963)

Back in 2018 i crawled 200Million urls of single site by using just freely avilable proxies on the internet to evade rate limits. i do not think it can be repeated today.

CDNs are blocking even my genuine requests.

[ Parent | on HN ]

Re:Mimicking a device is becoming almost impossible by aj3 on Monday June 28, 2021 @06:36PM (#27669183)

Sadly, it's easier than ever. Multiple botnets create open proxies which are easily discoverable, if you know where to look. Also, cloud providers give you more IPs you might ever need.

[ Parent | on HN ]

Re:Mimicking a device is becoming almost impossible by fukd on Tuesday June 29, 2021 @04:18AM (#27673236)

Cloud provider ip ranges are publicly known. They are the ones first get banned

[ Parent | on HN ]