Regardless of your feelings of not being at peace, civilization is absolutely a compromise. A world that avoids the compromises of civilization is not one that will be static and unchanging either.
Society expects less of you than ever before.
And are you not allowed to leave, as Christopher McCandless did (and other trancendentalists before him, more successfully). Plenty of mountain people operate under the assumption that they are entitled to be left alone, and they consider the US flag to be a flag of pirates. We should have room for those enclaves if their municipalities allow for them, I guess.
How is imposing universal laws, like "Don't murder", any different? Why don't we allow people to "opt-out" of things like, say, paying taxes?
You see, one way or the other, you are already living under a "vision" of the world imposed by other people, decided for you before you even existed.
I mean, there's plenty of things wrong with trying to steer humanity on to the "right" path, and at the top of that list is probably the arrogant notion that you know what "right" is while others don't.