News for hackers. Stuff that matters.
Re:Creepy Crawlies by tptacek on Sunday August 30, 2026 @12:44PM (#49500274)
This is the basic misconception behind the Anubis design. In an anti-spam system, there's a user/abuser reward asymmetry. Users make single requests and get some constant reward V. Abusers make millions of requests and also get some constant reward V. Proof-of-work exploits the asymmetry: costs are, by a factor of ~millions, disproportionately imposed on abusers.

That's exactly not what happens with scrapers. Scrapers make millions of requests, yes. But each one of those requests produces an average (token-denominated) reward V'. There's no asymmetry at all: you're just adding a fixed cost to each reward, for both users and abusers.

That's before you even get to questions like "does the system actually work, or does a single solve get practically unbounded rewards".

Re:Creepy Crawlies by progval on Sunday August 30, 2026 @01:41PM (#49500916)
> There's no asymmetry at all: you're just adding a fixed cost to each reward, for both users and abusers.

There is: users solve the PoW once, scrappers solve it every time they rotate IP addresses. Some of them change their IP address on every request, so they keep solving the PoW over and over.

Re:Creepy Crawlies by sunoforbrazilia on Sunday August 30, 2026 @04:15PM (#49502324)
"scrappers" opinion discarded
Re:Creepy Crawlies by tptacek on Sunday August 30, 2026 @05:09PM (#49502846)
That doesn't matter! Every time they successfully solve the challenge, they're getting the token reward. That's the missing asymmetry. In an anti-spam system, 99.999% of all transactions are unrewarded.
Re:Creepy Crawlies by graemep on Sunday August 30, 2026 @12:52PM (#49500357)
I wonder whether what Anubis is doing might be blocking agents that do not run JS or that have a timeout (or humans who give up as I just did)
Re:Creepy Crawlies by tptacek on Sunday August 30, 2026 @01:10PM (#49500558)
I suspect that's most of the value, and that the deterrent is about software construction and not about the proof-of-work, which I've been saying for the last year is a productive direction for Anubis to head towards. Instead, it's just sort of tormenting normal people, as a kind of performance of anger about AI.

Which: I get! If it's your site, perform all the anger you want.

Re:Creepy Crawlies by cyberax on Sunday August 30, 2026 @03:09PM (#49501793)
I have a small personal site with an exposed Git repository. I'm getting crawled from about 100000 residential IPs from several ASNs (mostly in Brazil). Each crawler makes a couple of requests per minute.

Anubis doesn't really help against this.

Re:Creepy Crawlies by GoblinSlayer on Monday August 31, 2026 @02:00PM (#49512718)
This, blocking granularity is a country, not ip address.