That's not the case. It literally is sending user input to the server, where the game is running, and then you watch a video back. That's the base technology that underlies every single gaming streaming service (to date, at least).