The challenges are (1) miniaturizing, (2) input devices and (3) social acceptance, but as far as I can see AR as the universal display technology is inevitable. Not sure though on the time frame and whether it will be glasses, lenses or implants.
https://thebulletin.org/sites/default/files/2018%20Doomsday%...
Today, my Apple Watch, iPhone, and iPad provide different "lenses" on my digital self + my digital stuff. If I run an errand without my phone, I can still make phone calls, text my wife, play my music, etc.
Things like CarPlay, Apple TVs, and HomePods are other lenses. CarPlay happens to need an iPhone now, but something wearable will be enough to power CarPlay at some point. Eventually, cars will have enough native computing power and connectivity that they won't require a proxy device to work.
By 2030 I expect AR smart glasses to be fairly common, hopefully with less-conspicuous options for people who don't need vision correction. Maybe they'll be powerful enough on their own, or work more like CarPlay and require a wearable complement. Additionally, voice user interfaces will continue to evolve and work with all of these lenses.
TLDR: Instead of today's "hero device" model, I think we're moving toward an "many devices" model.