That's not a problem unique to encryption. Firearms have good uses and bad uses - you can hunt and feed your family, or you could kill someone. With a powerful privacy advocacy group, as proposed by OP or like the EFF as mentioned by others, you can have the same voice like the NRA does to promote responsible "good" uses of firearms but for privacy technology.