Re:Creepy Crawlies
by simonw on Monday August 31, 2026 @09:17AM
(#49509419)
The moment we establish a standard for offering a "optimized for scrapers" version of a site, people who do not want to be scraped will weaponise that to serve junk to scrapers... and scrapers will subsequently refuse to use it.
[ Parent
| on HN ]
There are no comments on this comment yet.