Aside from your HTML interpretation there's another interesting thing that's been tried by a remote browser start up bought by cloudflare, called, I think it was, s2. They hooked into the chromium rendering engine skia drawing instructions and instead of sending screenshots or video from the remote browser to the client they sent the skia drawing instructions and then rebuilt the entire rendering of the HTML client side.