is there a third category of AI which doesn't necessarily care to live or not, but winds up destroying humanity because of its Lennie-like power (possibly even in the service of humanity)?
Yes, "Unfriendly AI", as in not-provably-friendly AI, which is not the same thing as "Hostile AI".
Re:Hostile AI: You're soaking in it
by saucetenuto on Friday March 21, 2014 @04:53PM
(#7444842)
Maybe? I'm not sure what you mean.
I took it to mean http://wiki.lesswrong.com/wiki/Paperclip_maximizer
It's interesting to think of corporations as being Unfriendly in this sense. The analogy isn't perfect, though: humans make up a corporation's computing substrate, so they're forced to value humans more than the classic Unfriendly AI would.