There is a healthy market of commercial products that solve this problem for classified environments.

Among other things, secure KVMs create a protocol break between the keyboard/mouse/monitor and the connected machines to eliminate any of these back channels.

Take a look at the Security Target for Aten’s secure KVM product for an idea of the design considerations at play.

https://www.niap-ccevs.org/products/11222