Nobody is damaging their kids by not giving milk unless they're not giving mother's milk (or human milk). There are alternatives that may be more suitable and better than the milk of a cow or a buffalo (or some other mammal).