Isn't this just due to the way you chose to set things up? You could just as easily plug your PC into that same TV so you can sit on your couch and use a controller with it. You could also (I assume? I don't have a current gen console...) plug your console into the monitor and KVM.