The problem, like you state, is not AR itself, it's that " no one is really thinking usability, interfaces, social exceptions, and realistic applications".

There is a movement that tries to move the world in a different direction, and I hope many more people will invest some serious time reading about the subject.

http://livable.media/

Here's a great place to start if you're interested:

http://nxhx.org/dfa/