Well, most of my recent computers don't have an option for keyboards that's not USB. But a system with no inputs is probably the most secure you can get.

You can also hotglue unused ports and physically prevent unplugging the intended devices. But that's not realistic for most systems.