The facts are easy to check:
http://www.usgovernmentspending.com/year2008_US.html
Of the top 5 biggest expenditures in the US as of 2008 (the last year for which full data is available), only the #4 expenditure (the military) was a public good. The #1,2,3 and 5 items together account for 58% of government spending in the US.
The basics mentioned by the original poster are actually pretty cheap. Water and sewers are about 2% of government spending. Police, fire, prison and courts were only 6%. Roads are another 5%. The military (the biggest public good expense) is only 14%.
Of course, education isn't a public good. It's rivalrous (you and I can't simultaneously enjoy the same seat in a classroom) and excludible (if you don't pay, they don't let you in). That makes it a private good.
I do still think that education should be a function of the government, however.
Edit to expand on my position: I had confused the terms public good and common good. I believe that a solid, (to some extent, but not as far as we are now) standardized education system is in the best interest of our nation. I don't think this could be provided privately.
even if I agreed with your assumption (which I don't), I would certainly not be able to agree that US taxpayers subsidized "less productive" for past 200+ years and US still became what it is now.