> I am still not really clear on why such a property is necessary or even desirable in the context of high dimensional statistical learning algorithms

Law, regulations, and human trust.