Theoretically, for DSA and RSA keys under 1024 bytes, they can be brute forced. If you have one of these keys, you won't want to expose them.

It's security through obscurity, but obscurity in addition to real security offers no real harm.