Re:Web Scraping and Crawling Are Perfectly Legal, Right? (2017)
by rayascott on Wednesday July 31, 2019 @04:52AM
(#20572666)
The author attempts to contrast web scraping and web crawling and gets it very wrong. This is what it actually is: web scraping - I download the content of a webpage or select webpages, web crawling - I download the content of the entire internet (or part thereof). How he can say that someone who's crawling the internet and building a search index with the contents of the downloaded data isn't also scraping the web, makes no sense.
[ Parent
| on HN ]
There are no comments on this comment yet.