Re:How Google’s Web Crawler Bypasses Paywalls
by ignoramous on Friday February 19, 2016 @02:48PM
(#11136062)
It isn't. But I have seen top internet companies (Netflix and the like) use it to authorise requests. It boggles my mind.
[ Parent
| on HN ]
Re:How Google’s Web Crawler Bypasses Paywalls
by seanp2k2 on Friday February 19, 2016 @05:52PM
(#11137364)
Curious where Netflix is using this to authorize requests. Any more info on that?
Re:How Google’s Web Crawler Bypasses Paywalls
by ignoramous on Friday February 19, 2016 @08:14PM
(#11138100)
Their Android app wouldn't let you through if the device is unrecognised, that is, if your user agent has strings which Netflix hasn't whitelisted. They also check model ID, and build fingerprint too, I believe. A standard practice in the Android world, for some unknown reason. I don't know if they have stopped doing that.