Re:Ask HN: How do you feel about web scraping?
by alkonaut on Wednesday June 07, 2017 @07:46AM
(#14505434)
Yes - Like I said I think it's perfectly find that the material I download from the internet has terms and laws associated with it. That is, what I do with what I download is subject to laws as soon as I e.g. try to publish it.
But my point is this: what service have I used, and what terms can I be assumed to have agreed to if I do this
> wget $random_url > /dev/null
That's what web scraping is. What I do with the scraped material is something completely different.
But my point is this: what service have I used, and what terms can I be assumed to have agreed to if I do this
That's what web scraping is. What I do with the scraped material is something completely different.