That's mostly solved by keeping a screen around for others. I've found that sending the PC output of what I'm seeing in VR to a TV in the same room turns an isolating VR experience into a group activity fairly well.

And if AR ever becomes ubiquitous, the expectation would be that multiple people could wear the headsets and all see the same AR info.