The problem is these alternatives need to have other nutrients added to them and be fortified with the things they lack compared to milk.

Go and look at a decent resource like nutrition data and compare what you get with milk vs the alternatives. Milk is far more nutritionally dense, and I'm not just referring to calories/macros. It has vitamins, a lot of minerals, and even omegas.