News for hackers. Stuff that matters.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by shiomiru on Thursday January 02, 2025 @02:03PM (#42577549)
The sad part is that it's trivial to get around CF's bot protection if you're writing a bot (just use curl-impersonate and buy residential IPs), but it's pretty much impossible to bypass as a human if their magical black box doesn't like your browser and/or IP address.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by derefr on Thursday January 02, 2025 @02:30PM (#42577832)
> it's pretty much impossible to bypass as a human if their magical black box doesn't like your browser and/or IP address

There are residential-IP-backed VPN services that you can use just like commercial VPN services — but they're mostly built on the backs of botnets, so it's ethically questionable to use them.

Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by michaelmior on Thursday January 02, 2025 @03:15PM (#42578335)
FWIW, StarVPN claims to have "ethically sourced" IPs. That is, not from botnets. Their pricing is quite a bit higher than many (cheapest plan is $20/month), but could be worth trying.

https://www.starvpn.com/

Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by mike_d on Thursday January 02, 2025 @05:38PM (#42579749)
The "residential VPN" providers setup fake ISPs or buy AT&T/Verizon business circuits with large blocks of IPs and sell them as residential.

They are easily detected if you are buying IP intelligence from one of the higher quality providers: https://app.spur.us/context?q=STARVPN_PROXY

Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by duckmysick on Thursday January 02, 2025 @07:02PM (#42580481)
The linked page shows a sign-in screen.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by michaelmior on Friday January 03, 2025 @06:50AM (#42584826)
Spur access requires a free account.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by michaelmior on Friday January 03, 2025 @06:50AM (#42584829)
That's helpful to know. I wasn't aware of this.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by devilbunny on Thursday January 02, 2025 @02:42PM (#42577957)
You could also use Tailscale back to your own IP if the goal is not having to trust public WiFi.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by makeitdouble on Thursday January 02, 2025 @08:04PM (#42580991)
To note, IP is only a part of it, and the full extent of what's baked into a CF score will never be explicited (for obvious reasons).

CloudFront being way past the simple blocking of IP addresses, I wouldn't be surprised if a mismatch between your IP block and your language/cookies would be enough to lower your score.

Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by shadowgovt on Thursday January 02, 2025 @03:27PM (#42578461)
Surprisingly, it still works as intended. Yes, it won't keep professionals and dedicated bot-fabricators out, but that's like 5% of the botters out there; the rest are the bot equivalent of script kiddies who can't be bothered, and it filters them great. Meanwhile, the script kiddies have a process that still works on non-CF sites, so they don't need to improve their process.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by solardev on Thursday January 02, 2025 @02:15PM (#42577691)
How does it get around captchas?
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by tedivm on Thursday January 02, 2025 @02:22PM (#42577750)
If they don't think you're suspicious they don't make you do the captchas, and as others have mentioned you can always outsource it to captcha farms. There are also AI models which do a fairly decent amount, and since most captchas let you repeat attempts with new patterns you can have a pretty high error rate to get past them. Then there's the ADA, which requires accessibility- many captchas have an audio component as a backup and those are easy to interpret by models.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by gruez on Thursday January 02, 2025 @02:26PM (#42577798)
Cloudflare turnstile isn't even a captcha. The user just has to tick a box. Behind the scenes there's a javascript challenge to make sure you're vaguely a browser and not some script a bazillion requests per minute.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by xdfgh1112 on Thursday January 02, 2025 @03:32PM (#42578535)
It's also used for proof of work as many scrapers are using thousands of IPs but only a few CPUs
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by michaelmior on Thursday January 02, 2025 @03:16PM (#42578348)
curl-impersonate doesn't solve CAPTCHAs, but the goal is to look enough like a human that Cloudflare doesn't present a CAPTCHA in the first place.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by gjsman-1000 on Thursday January 02, 2025 @02:17PM (#42577706)
You pay contract workers in a third world country a tiny amount of money per day, to spend all day clicking boxes.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by ghxst on Thursday January 02, 2025 @04:55PM (#42579358)
This is great for bypassing the server side bot detection but not the client side one, where it will attempt to verify the integrity of your browser environment.
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by hedora on Thursday January 02, 2025 @10:35PM (#42582090)
Well yeah, if you’re a legitimate user, CF will block you.

It’s only easy to bypass if you’re scraping or doing nefarious stuff.

Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by homebrewer on Thursday January 02, 2025 @06:08PM (#42580027)
It's the same for spam email, yet most spam gets caught in spamassassin rules that were written 20 years ago and haven't seen much improvement since then. Most bad guys just don't bother to do anything above the bare minimum. For example, I see lots of email getting caught in a rule that checks for incorrectly formatted pseudo-Outlook mailer header, which is trivial to circumvent if you pay any attention to it (the difference is in excessive whitespace, or a slightly incorrect "Outlook" version, or something like that).
Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by somat on Friday January 03, 2025 @01:00AM (#42582953)
see also: The surprising effectiveness of simply asking the spam server to try again(sometimes called graylisting). It shouldn't work at all, but proves to filter an awful lot of the worst mail noise.

http://man.openbsd.org/spamd

Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by hedora on Thursday January 02, 2025 @10:28PM (#42582042)
We bypassed it by switching to starlink. Now my IP address is a too-big-to-fail CGNAT.

The old IP address was a mom-and-pop CGNAT.

Thanks CF, for protecting us from capitalism, I guess?

Re:Tell HN: Impassable Cloudflare challenges are ruining my ... by PrimaryAlibi on Saturday January 04, 2025 @02:25PM (#42597000)
That's same for almost all surveillance/tracking tech. It's always trivial for criminals/abusers to bypass. The surveillance is just about controlling the sheep.