> Since we won't allow people to withdraw from society that means we're actively forcing people to live a specific way of life that some simply cannot handle.

Sometimes (although far less often than some people would like to assume) the person who withdraws is perfectly capable of handling the demands we force on people in our society, but they simply prefer to not participate. These people usually aren't sitting around all day collecting welfare checks, often they are the career homeless or living in isolated shacks in mountains. I can't really fault them if that kind of lifestyle is actually preferable to them.