This line of thinking sounds consistent but actually isn’t: even if you’re against the government interfering in your life, you’re still entitled to the benefits that you paid for. Your line would only be consistent if the individuals could opt out of paying. This is the source of the “coercion” claim that libertarians make.