When you elect representatives, you delegate a lot of authority to those representatives. No one picks who to vote solely on nuclear policy, and you could argue that if it you actually polled voters it probably wouldn't rank very high in terms of priorities, especially not nuclear at any cost.