News for hackers. Stuff that matters.

A comment on Block AI Scrapers with Anubis proof-of-work.

Re:Block AI Scrapers with Anubis proof-of-work by hoppp on Thursday March 20, 2025 @09:39PM (#43431032)
"If the client has a User-Agent that does not contain "Mozilla", the client is allowed through."

So if an LLM bot can identity the Anubis Pow check, it can just update its user agent and it passes without needing to complete the pow?

[ Parent | on HN ]
Re:Block AI Scrapers with Anubis proof-of-work by kotenok2000 on Friday March 21, 2025 @10:14AM (#43435964)
Wouldn't Anubis notice that the an ip didn't finish pow check disconnected, and returned with different useragent?
[ Parent | on HN ]
Re:Block AI Scrapers with Anubis proof-of-work by hoppp on Friday March 21, 2025 @11:51AM (#43437108)
So they can rotate IP too?
[ Parent | on HN ]
Re:Block AI Scrapers with Anubis proof-of-work by kebokyo on Friday March 21, 2025 @01:06PM (#43438237)
There is a config file that lets you customize the rules Anubis uses for allowing, challenging, or denying incoming requests. https://anubis.techaro.lol/docs/admin/policies
[ Parent | on HN ]