The government, and only the government, will write a check (or legislate and require others) to build low-cost housing, provide food for poor children, or provide healthcare so that we don't have lepers dying in the streets. That's not a society, and individuals aren't going to do anywhere near enough - they had their opportunity in 1895, and they acted selfishly, which is how we eventually got to 8 hour work days, medicare and social security.
Libretarians are as guilty as progressives. While the stereotype of zero regulation is untrue, most would argue only for regulations that benefit them, and believe that regulations that detriment them are the one that are unfair. (As a defense of myself and my position - I do the same, but I also acknowledge that, and consider the fact that most people are arguing in their own self interest an important part of how we achieve 'fair')
This is a sardonic and mean-spirited view, but it is a necessary devils advocate - Too much is done with 'hope', not strategy.
Why not? Complete self-determination is essentially "Fuck off" to everybody else at best and wholesale exploitation at worst.