There are attacks against RSA signatures when padding is omittted.
Obviously. But for checking the padding on a signature you only need the public key. So you cannot leak any sensitive RSA key material while checking the padding.
Padding attacks don't leak key material; they leak plaintext.
Right an attack on an RSA signature that leaks plain text. Really? Must be a super secret signature then.
You should familiarize yourself with how RSA works, and what an RSA signature is.
Assuming properly authenticated data, then decrypting without checking padding is no problem. For RSA encryption, padding only protects the sender. By itself RSA encryted data cannot be trusted, you need separate integrity protection for that.