News for hackers. Stuff that matters.
Re:Web Scraping and Crawling Are Perfectly Legal, Right? (2017) by rayascott on Wednesday July 31, 2019 @04:52AM (#20572666)
The author attempts to contrast web scraping and web crawling and gets it very wrong. This is what it actually is: web scraping - I download the content of a webpage or select webpages, web crawling - I download the content of the entire internet (or part thereof). How he can say that someone who's crawling the internet and building a search index with the contents of the downloaded data isn't also scraping the web, makes no sense.

There are no comments on this comment yet.