Rest of the VR industry already systems that only really put the rendering hardware to use where you're looking it's called Foveated rendering, because essentially your eyes can't even see the detail in the edges of vision even if it were rendered there. Handles this all very fast and seamlessly.

Not a stretch the same thing could be applied to a virtual desktop environment especially when you have eye tracking.