I had the same experience with Google Daydream (RIP). It's a really neat immersive experience to try out a couple times, but I could never seriously watch anything in there because it was just plain unpleasant.

I like the VHS comparison, but I would argue it's worse than that because you get a weird screen door effect if you're on any kind of angle that tends to distort things weirdly. I think Netflix had a decent tradeoff where the "screen" was rather large, but it feels like sitting in the front row of an IMAX where you're moving your head to see everything.