You highlighted two major barriers of entry for the larger market: 1. Initial Cost 2. Technological knowledge required (to inform the purchase and to set it up)
Another point adding to the cost is that VR games of any quality [or by larger studios with resources for quality development] are new games, and as such usually run around 60 to 100 dollars each. And they don't just come on a disk you pop in and play.
Sidenote: Playstation VR, which is substantially easier to set up -- the headset is more expensive than the console at this stage. If you get the starter bundle it's almost 3x the cost of the console.
To many people, it's outrageous. And the argument would likely follow, "there just aren't that many good games for VR" or "I just bought a new 4k tv, why would I buy that _now_". (At least this is what I've heard so far)
Playstation VR seems like a terrible deal at this point with the Rift price drops and deals. Most of the cost of a VR capable PC with a Rift with vastly inferior experience.
I don't have a Playstation myself, I play on a PC when I do. The rest of what you said sounds about right.
I can only use a Vive if I have a high powered gaming computer in a place conducive to gaming.