News for hackers. Stuff that matters.
Re:Creepy Crawlies by inigyou on Sunday August 30, 2026 @02:14PM (#49501248)
The way they're internally implemented doesn't allow pinning an IP. They buy a rotating proxy service from a vendor, and don't get to choose their source IP.
Re:Creepy Crawlies by semiquaver on Sunday August 30, 2026 @07:39PM (#49503938)
Why are you and other defenders of the Anubis approach so fixated on this one specific limitation of a certain type of scraping architecture? It’s hardly an immutable characteristic.

You say “they” as if all scrapers are a monolithic group with the same constraints and goals. Part of the problem is the massive diversity.

Re:Creepy Crawlies by inigyou on Monday August 31, 2026 @05:51AM (#49507767)
Why do you think anyone thinks it's immutable? Do you understand the basic concept of an arms race, or cat and mouse game?
Re:Creepy Crawlies by rstuart4133 on Sunday August 30, 2026 @10:02PM (#49504805)
It's not hard to test. Go to a page that demands PoW, change your IP and see what happens. I just did it. Spoiler: kernel.org asks for a new PoW.

If the source IP was an issue, you could do it other ways: for example, make the cookie rotate on every access, and insist there is a single stream of accesses.