Re:Scrape like the big boys
by IceWreck on Friday November 05, 2021 @08:58AM
(#29118547)
The author says proxys are expensive and then proceeds to spend a shitton of money buying all that hardware.
[ Parent
| on HN ]
Re:Scrape like the big boys
by incolumitas on Friday November 05, 2021 @10:53AM
(#29120129)
4G proxies are just soo much better than so called "residential" or straight datacenter proxies. It makes sense to create your own 4G proxy farm if you conduct business in that area.
With only 10 dongles and 10 dataplans, you can have a lot of IP addresses that are extremely hard to block. It's an one time investment, paying proxy providers is a fixed cost.
Where do you get 4G dongles that don't suck nowadays?
We tried to get some, but all of the ones we could get were various levels of broken or unsupported.
That was not the authors main argument against proxies, that was just an additional point. You ignored the primary argument in your judgment.
>>Because I could not fully trust the other customers with whom I shared the proxy bandwidth. What if I share proxy servers with criminals that do more malicious stuff than the somewhat innocent SERP scraping?
Re:Scrape like the big boys
by RandomThrow321 on Friday November 05, 2021 @10:42AM
(#29119961)
Can they not call out a secondary point?