They can check the signature if you challenge a transaction. If it doesn't match, that supports your claim, otherwise it weakens it.