News for hackers. Stuff that matters.
Re:Cloudproxy – hide your scrapers IP behind the cloud by tushar-r on Saturday June 26, 2021 @06:01AM (#27640607)
This is relatively easy to block, given that these companies publish their IP ranges. Similar to the Tor block, blocking "datacenter IP's" simply becomes the norm. This is why you have companies offering "resi's" or residential proxies to bypass such blocks for some years now.
Re:Cloudproxy – hide your scrapers IP behind the cloud by TheFreim on Saturday June 26, 2021 @06:19AM (#27640697)
I heard a while back, on HN 8 I think, that a lot of residential proxies are computers that have been infected with malware. How true is that?
Re:Cloudproxy – hide your scrapers IP behind the cloud by robjan on Saturday June 26, 2021 @06:23AM (#27640713)
There have been a number of Chrome extensions which monetize by selling your bandwidth to provide this kind of service. Not ethical but probably not a compromise.
Re:Cloudproxy – hide your scrapers IP behind the cloud by oefrha on Saturday June 26, 2021 @07:35AM (#27641021)
Browser extensions, and VPNs. Notably, Luminati was allegedly selling HolaVPN users as exit nodes. https://www.trendmicro.com/vinfo/hk-en/security/news/cybercr...
Re:Cloudproxy – hide your scrapers IP behind the cloud by dstick on Saturday June 26, 2021 @10:59AM (#27642420)
This is not alledgedly but very much true. I was in the proxy business for a few years and in talks with the Luminati people to white-label their product for a very specific type of proxy.

It’s such a weird field to be in. It’s not illegal by definition of law, but you’re definitely in shady territory, with most of the customers being of the “get rich quick” persuasion. Or at the very least trying to cut corners. One way or another, they were not playing by the rules ;-)

Re:Cloudproxy – hide your scrapers IP behind the cloud by Scoundreller on Saturday June 26, 2021 @08:03PM (#27647182)
Also the economic basis of a lot of "cell-phone farming".
Re:Cloudproxy – hide your scrapers IP behind the cloud by 0xy on Saturday June 26, 2021 @08:45AM (#27641374)
A significant portion are grey market "ISPs" that purport to sell residential services but actually never do.

They sell these "residential" IPs to Amazon, other ecommerce retailers and shady people for an extreme price.

In the e-commerce world, scraping is necessary to stay in business. Amazon has armies of scrapers constantly monitoring their competitors, and in some cases automatically undercutting price updates.

Re:Cloudproxy – hide your scrapers IP behind the cloud by Scoundreller on Saturday June 26, 2021 @08:05PM (#27647188)
Same on the consumer side. I like setting up alerts on camelcamelcamel and seeing price history (to make sure I'm not getting screwed) and to buy buy buy when prices hit a certain theshold.
Re:Cloudproxy – hide your scrapers IP behind the cloud by samjmck on Saturday June 26, 2021 @06:23AM (#27640714)
Are there even ethical or “official” ways to source residential IPs? I thought most of them were from botnet infected IoT devices.
Re:Cloudproxy – hide your scrapers IP behind the cloud by pseudo0 on Saturday June 26, 2021 @07:13AM (#27640930)
I've heard of services that offer free proxy bandwidth in exchange for the user acting as a residential proxy node for other users and/or paying clients. It's generally marketed as a way for the user to avoid geoblocks and such. If this is clearly stated to the user upfront rather than buried behind half a dozen dark patterns and fine print, it seems like this business model could be conducted ethically. When it comes to whether the companies in this space are currently acting ethically though, I have serious doubts.
Re:Cloudproxy – hide your scrapers IP behind the cloud by cinntaile on Saturday June 26, 2021 @07:21AM (#27640963)
You have autobuying bots (sneakers or GPUs or other limited edition stuff) that need to do tricks like this. I wouldn't necessarily call them unethical.
Re:Cloudproxy – hide your scrapers IP behind the cloud by pseudo0 on Saturday June 26, 2021 @08:12PM (#27647230)
In my opinion it's unethical if the website explicitly states in their terms of service that bot purchasing is not allowed. As far as I know, that is pretty common for websites that sell frequently scalped products, and near-ubiquitous among those that implement technical countermeasures.

I'd expect cybercriminals and fraudsters also find a pool of disposable residential IPs to be very useful.

Re:Cloudproxy – hide your scrapers IP behind the cloud by cinntaile on Sunday June 27, 2021 @06:47AM (#27650433)
A Terms of Service is not a proxy for morals though. Companies will put whatever is convenient for them in there, I'm sure you can come up with several examples that you wouldn't consider ethical.
Re:Cloudproxy – hide your scrapers IP behind the cloud by alephu5 on Saturday June 26, 2021 @08:52AM (#27641416)
I worked on a fairly large web-scraping project (around 2 million pages per day) and we used luminati. Amongst other things, they offer genuine residential proxies with user consent.

https://brightdata.com/proxy-types/rotating-residential-ips

Re:Cloudproxy – hide your scrapers IP behind the cloud by ipython on Saturday June 26, 2021 @09:02AM (#27641479)
Reading that page, the “user consent” is dependent on third parties who are monetizing their app through this service to inform their users. I … um … doubt the third party app developers give a crap to accurately describe the traffic that will subsequently emanate from their users’ devices.

Just like everything else in this industry, the retort will be “but it’s the users fault! They didn’t scroll through the 2,375 page privacy policy, user agreement, hold harmless indemnification agreement, and terms of use when they agreed to an ad free experience for their mahjong app! What a stupid user! Ha!”

To that I say, enjoy the coming oppressive regulations. It’s already started. As a kid, I always wondered why we required stupid laws to regulate common sense. Now I know why.

Re:Cloudproxy – hide your scrapers IP behind the cloud by KirillPanov on Saturday June 26, 2021 @03:29PM (#27645015)
We don't need oppressive regulations; we simply need courts to adopt a sane definition of "agree".

If you're foisting an adhesion contract on more than 1,000 people, they are not deemed to have "agreed" unless a majority of a random sampling (say, ten) of them actually read and understood the entire document. Otherwise it's void. "Read and understood" is decided by a jury as part of any litigation involving the contract. "Random sampling" is made by court evidentiary procedures.

If the contract is negotiated or it was presented to less than 1,000 people the rules stay the way they currently are, since those are the kinds of contracts that English common law was developed for.

Re:Cloudproxy – hide your scrapers IP behind the cloud by detaro on Saturday June 26, 2021 @09:07AM (#27641514)
> " with user consent."

things like this are ... iffy at best: https://www.vice.com/en/article/pga9yk/your-tool-to-access-n...

Re:Cloudproxy – hide your scrapers IP behind the cloud by dreyfan on Saturday June 26, 2021 @09:23AM (#27641593)
luminati runs on holavpn which installs backdoor proxies on people's machines. that "user consent" is not actually known to the users but is buried in some terms & conditions when they're naively installing the "free VPN" software.
Re:Cloudproxy – hide your scrapers IP behind the cloud by bacheson1293 on Saturday June 26, 2021 @01:17PM (#27643783)
this company is run by a bunch of scam artists...they scammed me out of close to $10k
Re:Cloudproxy – hide your scrapers IP behind the cloud by abc03 on Saturday June 26, 2021 @10:36AM (#27642225)
Packetstream.io buys bandwidth from users and is cheap. I‘m a customer.
Re:Cloudproxy – hide your scrapers IP behind the cloud by Scoundreller on Saturday June 26, 2021 @08:20PM (#27647277)
Pretty good margins: They pay users $0.10/gb and they sell it to you for $1.
Re:Cloudproxy – hide your scrapers IP behind the cloud by devit on Saturday June 26, 2021 @08:45AM (#27641378)
You can buy a bunch of mobile SIMs and use them.