I think a big part of the reason is that the common man confuses privacy and security. You see this with statements like, "Well, I don't have anything to hide... so I don't care." The media and politicians didn't (don't) help with this confusion, either.