Yes, the big brain types sometimes get really pissed off when they find out they were tricked into voluntarily consenting into a bunch of stuff.

When you get/renew passports, leave the SSN box blank. It will become second nature to ignore these data requests.