Europe is not small. And lots of European countries are investing/have invested heavily in their rail networks, especially compared to the United States.

Spain and France have extensive high speed rail and regular rail networks. There's an EU level initiative to connect all the national rail networks and facilitate the creation of robust pan-euorpean rail services.