Most of the time the reason for a KVM is wanting to switch the monitor, mouse and keyboard, and possibly other devices (e.g. I want to use the same webcam that remains in the same position) at the same time.

Switching just the monitor isn't really the use case they address.