I think they would have to get to the point where they are similar to regular sunglasses[0]. And the set up would have to be as simple as picking up a remote and turning on the tv. IOW, when someone puts on the VR glasses, they auto connect and start up immediately with little user intervention. Anyone other than a geek/nerd/techie, doesn't want to 'fiddle' with something to use it. They want it TV remote easy.

[0] Though I still tend to think that even this would not be enough for most people - see 3D glasses/TVs.