Not really. You pay taxes to fund the fabric of society. That means self-defense, but it also means other common goals such basic infrastructure and social services. You may not want to, but you do, and your individual want isn't the sufficient to change where your contributions actually go. We live in a democracy, and in a democracy, the majority rules even if the minority is vocal and irritated by that majority decision. Subject to the constitution, of course.