I would counter that differentiable programming should perhaps rise to the level of baseline functionality that most languages should offer.

I think the applications for automatic differentiation and gradient optimization well exceed what we think of as ML and data science today.