In this case, the "client" would be the game render server. Your terminal -- which has the display -- is the "server."

This is already the way OnLive, for example, works. All the rendering is done on the server side, which corresponds to the Wayland/X11 client.