Would you mind elaborating more on where you draw the line between "good" and "bad" behavior when it comes to scraping?

Is it obeying robots.txt, the monetary purposes (profit / non-profit)?..

I personally have a hard time accepting that a website can allow Google to scrape all their content, but prevent others. In my view, this is anti-competitive behavior favoring a large and evil corporation. Argumenting that Google delivers value back in the form of traffic is unacceptable to me, because it goes against basic principles of net neutrality, which I support.

I'm intetested in reading your thoughts on this.