It's kind of unpleasant to have your head stuck into a virtual object. People generally avoid objects in VR, too.