Not necessarily. The guns and ammunition are more valuable. You could trade them (or your time in protecting them) for the other things without stealing.

Besides, I think it's a moot point because I know a lot of preppers and they're all very aware of concerns like safe drinking water and food.