In the case of physics, the name tensor is well deserved and used with purpose---the object are mathematically speaking tensors (and where called tensors before computers existed). Their naming is unrelated to their physical representation in memory, even though they end up being arrays. The same is true for various engineering disciplines.

For ML, it just turns out that they can talk about their objects and the corresponding operations also mathematically as tensors.