And yet, that still doesn't mean anyone is acting like it only has a single purpose, but rather that they dislike one of its purposes strongly enough to dislike the whole thing. It's ok to argue that the point of view is unreasonable, but not to be willfully ignorant or just dishonest about what their point of view actually is. If you said "but it does all these other great things!", they would say "I don't care, I still hate it", not "oh, I didn't realize that, I like it now".

Also, you can't actually tell what someone is doing with it, so complete shunning is the only way to be sure you aren't being recorded. Some people don't like being recorded at all, and most people don't like being recorded surreptitiously. These really aren't absurd or paranoid preferences.

If you're paranoid enough to think that anyone wearing Glass might be not only recording you but also painting over the active-camera light and lying to you about it, then I don't understand why you're not also worried about everyone on the street having buttonhole spycams in their lapels. Surely our hypothetical lying spy would prefer something less obtrusive.