Re:Detecting Chrome headless
by chongli on Saturday August 05, 2017 @01:20PM
(#14936735)
Be careful with that. Users with screen readers may fall into your trap.
[ Parent
| on HN ]
Could you have the content of the page explain that its a bot trap (so screen reader users know its not worth visiting) and only block if, say, an IP visits it multiple times in a short window?
Wouldn't block specialised scrapers as they would know to avoid that URL/link (though they'd probably work it out anyway), but would still limit more broad crawlers.