Not all fads get adopted. AR is in my opinion still a tech before its time, which makes it a fad - for now - but not necessarily forever. Cellphones and particularly smart watches are a form of ambient technology that have caught on, and I think it's only a matter of process shrinkage and battery tech before it happens. Say another 7-10 years for battery density to double again. Early ebooks were objectively as bad as current or last generation VR equipment. Nobody was going to adopt that. It's a matter of connecting the dots.
If you don't like the idea of everyone in AR, that's fine. Then I recommend you start now to participate in environmental and conservation special interest groups, because there is a day coming when philosophers, ascetics, and people who touch trees on purpose are the main demographics of people who actively reject augmentation for augmentation's sake. There are loud opinions in each of those groups, and they have merit.
And frankly we could use a few more science-minded tree huggers to dilute the conspiracy theorists.
I used to be in a social circle where a couple people claimed they would rather die than ever own an ebook. I wish I had written down which people they were so I could RemindMe in ten years to see if they were enjoying the afterlife or not.
When we are in the early adoption phase there are always late adopters who expect to be never adopters. But peer pressure happens, and some products actually listen to complaints and improve the product to overcome reservations.
And then everything goes to hell in a hand basket.