If you really want to get technical, the key defining characteristic of a train is that it consists of multiple connected railway vehicles that move together. A railway vehicle is of course a vehicle that runs on tracks.

So there are some tram/streetcar/light rail systems out there (like the one in New Orleans) that consist of individual railway vehicles, and are thus not trains.