As it turns out, 99.9% of us households have a fridge (http://www.eia.gov/emeu/recs/appliances/appliances.html). Those weren't really available in 1900, yet I don't remember any huge government subsidy for those (and by keeping your food fresh they prevent diarrhea and improve hygine). I do remember huge, private, factories making them, however.
But even then soap is likely also one of those things that really help prevent deceases through proper sanitation -- yet how poor do you have to be to not be able to afford soap?
A fridge is much more expensive, but it's also much more a luxury. You don't need to refrigerator to avoid diarrhea, it just helps. Pure running water on the other hand is extraordinarily cheap and makes avoiding waterborne illness easy. (Due to the fact that running water is provided by public utilities, not free markets.)
I'm not saying the free market doesn't have a part to play in good hygiene, but trying to rely on the free market for a water supply and food handling regulations has been an unmitigated disaster everywhere it's been tried.
England is served by private water companies. Is this a disaster?