Not just distance, but time. If you try to keep milk around for any amount of time after milking the cow, you run risks like Bird Flus and TB and other disease contaminants.

Which is also why in the other direction cheese was invented for time stability of milk.