Re:Bypassing website anti-scraping protections
by AznHisoka on Friday June 01, 2018 @01:37PM
(#17207879)
Linkedin is even worse, imo. Go to any random company page and it'll show you a page, asking you to login. Refresh it again and it'll show you the page, without asking you to login.
[ Parent
| on HN ]
Re:Bypassing website anti-scraping protections
by jorge_gonzalez on Saturday June 02, 2018 @06:01AM
(#17213827)
That is probably because LinkedIn Authwall algorithm is on A/B testing, they do lots of machine learning so that they stop bots, but mostly scraping Linkedin is quite impossible i would say even on small volumes