Great idea! In fact look at what nvidia is doing with videocalls (spoiler exactly what you’re saying, but video)

https://blogs.nvidia.com/blog/2020/10/05/gan-video-conferenc...