I find this very doubtful indeed. The state by and large spends money on things the private sector has no interest in, such as welfare systems; I fail to see how this starves/steals from private sector solutions (no one makes money by supporting old people; no one makes money providing medical help for the poor; no one makes money by polluting less; no one makes money off going to the moon, though lots of people make money off the research that comes from it, etc.)
http://www.ssa.gov/oact/STATS/admin.html
2% or less admin costs looks pretty good. A universal basic income system would be better, but I'd be interested to see some private charities that do better than this.
> the private sector has no interest in, such as welfare systems
Absolutely false. Children take care of their parents, families take care of each other, friends offer housing and food to their friends. At best you can argue that the private sector has stepped back to the extent the state has stepped in.
> Children may take care of their parents, families may take care of each other, friends might offer housing and food to their friends.
At least one theoretical advantage to the state system that rarely gets talked about is that while its assistance also has the same conditionals, at least in principle, the conditionals are dependent on objective criteria. The state of your relationship to friends and family is immaterial; you don't have to accept terms imposed by religious charities or other organizations that will attach moralistic strings.
The reason there are very few remaining alternatives is largely because (in most systems of government today) the State has taken tax dollars from the private sector's solutions, thus starving them of resources, to fund it's own competing solution. So, the State is taking resources from it's competitors and then provide an alternative (normally at subsidized prices), which makes it's competitor's market share smaller and also sets pricing at unsustainable levels. There is only one outcome, ever, to this type of arrangement, regardless of whether or not the State actually offered the best solution to its citizens.