When I had a headset, I think the main thing that kept me from using it was the inconvenience. You have to keep part of a room clear, deal with a mass of cables, the weight of the headset, its positioning on your head, finding somewhere in reach to store it, etc. The lightweight wireless headsets of the future will help a lot. Smartphone vr is promising from this angle

Honestly, the privacy policy made me a bit uncomfortable too