Re:Ask HN: Best practices for ethical web scraping?
by codingdave on Saturday April 04, 2020 @03:28PM
(#22780785)
You are correct that I don't like this advice... not because I find it to be wrong, but because you are approaching it solely from a competitive perspective -- "Your competitors don't have ethics, so you shouldn't either." That doesn't help someone who is engaging in research and trying to hold themselves to a higher standard.
[ Parent
| on HN ]
Re:Ask HN: Best practices for ethical web scraping?
by jdc on Sunday April 05, 2020 @12:16PM
(#22786437)
It seems to me that you are conflating ethics with compliance.
Re:Ask HN: Best practices for ethical web scraping?
by codingdave on Monday April 06, 2020 @07:32AM
(#22792761)
When the compliance we are talking about is whether or not to communicate clearly to others who you are, and whether or not to respect their directions, are you so sure they are not correlated?