The difference is that your eyes have much higher "resolution" in the centre of your view compared to the peripheral vision. But your eyes move all the time, so unless you can move the screen as fast as your eyes moves, a VR headset needs to have that highest resolution across your entire field of view.
But that's more pixels than your retina has photoreceptors when you consider full colour (6M but it takes several of them working together to form a "pixel" equivalent)