Re:A Practical Exercise in Web Scraping
by prolways on Monday December 16, 2013 @12:41PM
(#6916354)
Isn't this wildly illegal? I thought all web scraping violated CFAA... not to mention copyright...
[ Parent
| on HN ]
In many cases how is it different from visiting each page and printing/saving the html?
It's useful to create a backup of the site[1].
I'm not saying it's good or bad. It could be used for both. I know at my previous job we used it (a bit shady I think) to scrape and compare competitor prices to ours.
[1] Though I can't understand why you'd want to backup your own site but I am pretty sure I've heard of it being done.
> I thought all web scraping violated CFAA... not to mention copyright...
I hope this doesn't apply to meta tags and outbound links otherwise one of my projects just got a lot more awkward.