The problem in Europe for freight trains is that Europe generally doesn't have as long routes as the US and on long routes in Europe you cross different countries, which have incompatible voltages and power systems, different signaling systems, etc. which makes it complicated to run trains across. Not to mention countries outside the customs union, where extra processing is needed.

On short distances a railway is simply less efficient than trucks.

Also companies have optimised their storage and logistic chain to expect for example one truck each day instead of a train each week and thus are using the road as storage facility.