The Titan chip does a lot more than sign and store keys. It also has storage (could contain malicious payloads) as well as an RNG and AES/SHA accelerators (which could be weakened/compromised), among other things.