I wouldn't be surprised at all if, at some point, a lot of people routinely wear some sort of AR when out in public. It's possible there will be widespread social pushback (i.e. the Glasshole factor). But I wouldn't bet on it if such a thing were genuinely comfortable and useful.
Not sure how much longer that will be the case. People will soon be walking around with the personal equivalant of a police officer's body camera, always on, recording every moment and every interaction with another person.
I would be reluctant, and probably refuse to talk to anyone wearing such a device, but it won't be long before it's not even obvious.