News for hackers. Stuff that matters.
Re:Scrape like the big boys by IceWreck on Friday November 05, 2021 @08:58AM (#29118547)
The author says proxys are expensive and then proceeds to spend a shitton of money buying all that hardware.
Re:Scrape like the big boys by incolumitas on Friday November 05, 2021 @10:53AM (#29120129)
4G proxies are just soo much better than so called "residential" or straight datacenter proxies. It makes sense to create your own 4G proxy farm if you conduct business in that area.

With only 10 dongles and 10 dataplans, you can have a lot of IP addresses that are extremely hard to block. It's an one time investment, paying proxy providers is a fixed cost.

Re:Scrape like the big boys by bsder on Friday November 05, 2021 @05:20PM (#29124857)
Where do you get 4G dongles that don't suck nowadays?

We tried to get some, but all of the ones we could get were various levels of broken or unsupported.

Re:Scrape like the big boys by palijer on Friday November 05, 2021 @09:10AM (#29118680)
That was not the authors main argument against proxies, that was just an additional point. You ignored the primary argument in your judgment.

>>Because I could not fully trust the other customers with whom I shared the proxy bandwidth. What if I share proxy servers with criminals that do more malicious stuff than the somewhat innocent SERP scraping?

Re:Scrape like the big boys by RandomThrow321 on Friday November 05, 2021 @10:42AM (#29119961)
Can they not call out a secondary point?
Re:Scrape like the big boys by pnt12 on Saturday November 06, 2021 @08:38AM (#29129710)
Sure but nitpicking does not lead to productive discussions.