You can also organize among your minority group and protest that your rights are being violated, or hire lawyers to sue.
I’m not concerned with people who don’t want to participate. They don’t have to and we don’t need their support. Such a system can be supported entirely by those who want to support it.
I’m sorry if I come off confrontational but your question seemed to be a “gotcha” that is honestly very simplistic. As an anarchist or “libertarian socialist” I’m quite aware of problems of the state. I will say that in many cases I think local governments may find it beneficial to support these systems, but I like the idea of this being done on a local level so individual cities can decide for themselves. In the same way that some governments operate trains, it is not the case that trains depend on government to be useful.