Re:It is not possible to detect and block Chrome headless
by odammit on Thursday January 18, 2018 @06:23PM
(#16182578)
Build a revshare API.
I assume the people that can't afford it are using it for non-revenue generating purposes. I don't know that I'd care about those people if they aren't taking away from my bottom line.
Re:It is not possible to detect and block Chrome headless
by sushid on Thursday January 18, 2018 @06:23PM
(#16182580)
Because you'd presumably need to authenticate (and have a paid account) to access the data.
Re:It is not possible to detect and block Chrome headless
by odammit on Thursday January 18, 2018 @06:26PM
(#16182600)
I think they meant, since they can't afford the API, they'd just keep crawling your HTML. Combo move the API and putting your stuff behind auth and you solve a lot of the problem.
You've gotta get that good yummy content publicly accessible for google though, so you'll rank. So, that's a balancing act.
I think your suggestion would reduce crawling, but not prevent or block it.