Web Scraping in 2016

Re:Web Scraping in 2016 by hobs on Tuesday August 23, 2016 @05:46PM (#12347989)

And the original point of my comment was that doing this is extremely rude and not appropriate, not that it couldn't be done or that others weren't doing it.

Feel free to send any request to any server you want, it is certainly up to them to decide whether or not to serve it, but that doesnt absolve you of guilt from scraping someone's site when they explicitly ask you not to.

[ Parent | on HN ]

Re:Web Scraping in 2016 by cookiecaper on Tuesday August 23, 2016 @06:00PM (#12348104)

Please don't conflate "extremely rude", "not appropriate", and "guilt". Two of these are subjective opinions about what constitutes good citizenship. The last one is a legal determination that has the potential to deprive an individual of both his money and liberty. We're discussing whether these behaviors should be legal, not whether they are necessarily polite.

[ Parent | on HN ]

Re:Web Scraping in 2016 by hobs on Wednesday August 24, 2016 @01:44AM (#12349932)

I never did.

You are posting in a comment thread underneath my reply about rudeness and impoliteness, ironically being somewhat rude telling me off about what not to conflate when it was never what I said.

[ Parent | on HN ]