I've tried the HoloLens, and it's not bad for what it does. The narrow field of view is the main limitation. Putting in a greyscale filter to dim the real world makes the inability to write dark tolerable. It's amazing how much hardware they crammed into a lightweight, wireless headset.
The VR headsets, on the other hand, are still about as clunky as they were in the 1990s. The head tracking is much better, and the resolution is a little better. They're still too heavy, too bulky, badly balanced, and need cables.
How good does AR need to be to do HyperReality?[1] Not much better than the HoloLens
You're underestimating the problem significantly. Read the link I posted previously because I lay it out there in detail. (I don't get paid or referrals or anything if you read it, it's just that I already wrote it all out there and don't want to do it again). FOV and draw dark are far from trivial issues, not to even mention content and geolocalization/georectification.