There are several reasons, terrain being one of them.

Also the commuter/long distance tracks are all owned by the freight liners, so passanger trains have to yield for them. There are also hour+ stops at some stations.