Many people are interested in Glass as a heads-up display or wearable computer, not as a camera. "Many" may end up being a very small number, but it stands to reason that it's larger than the number of people that actively desire to record strangers.
Unfortunately, the current model requires both a microphone (to hear you) and a camera (to see gestures), so even well-intentioned users will still be brandishing recording devices in ways that make others uncomfortable.
I don't think much of Glass. Just doesn't appeal to me but I am curious about what makes it special for others.