We already have phones in our pockets. Allow me to stick a cable from my HMD into my phone and I’ll be perfectly content to carry the extra weight around. It just has to look decent at the ‘head-mounted’ part.