No you're not held liable, but it's a giant pain in the butt proving that you're the actual owner of your SSN. It also significantly delays your refund (if you're due a refund).