That's silly. We're already pretty close, and if they really had to offload some things then the powerful computer that's a couple feet away in your pocket would make much more sense. Plus, as I said we already stream HD video on 4G networks without much trouble.
Wearing small backpacks and fanny packs while urban adventuring is not uncommon. AR companies could just bootstrap off that already existing "infrastructure" with small backs that can still carry stuff, but with AR tech also inside them.
You aren't going to stream anything to a headlocked headset over anything bigger than your LAN. Network latency will make you ill. And no, async timewarp is not the answer. That only gets you incidental movement from user to view. You still get massive latency in reactions to input, which can't be faked.
Oh, I suppose maybe someone is thinking of 360 video. Not anyone I know. But could be someone.
With Carmack leaving at Occulus and a lot of the startups not really amounting to anything I'm not so sure that this is just an issue of not enough mobile bandwidth.
Speaking for myself, I have no actual interest in AR/VR. It doesn't bring me anything that I need or would use for more than the novelty factor. I suspect that I'm in the majority here.
Where this tech shines is in niche markets -- gaming, industrial uses, and so forth.