Re:Bypassing website anti-scraping protections
by anc84 on Friday June 01, 2018 @09:35AM
(#17205123)
You could argue that Google should work on their own knowledge database instead of learning from other people's content and/or presenting other people's content in their own frontends (shopping etc)...
[ Parent
| on HN ]
Re:Bypassing website anti-scraping protections
by heavenlyblue on Friday June 01, 2018 @10:08AM
(#17205433)
This is what Common Crawl does: http://commoncrawl.org/. I think more people should know about it.