The latencies involved would make you barf in matter of minutes. Streaming over wired ethernet is already barely adequate for action games and VR requires significantly lower latency to feel good.