100mph is not a "high-speed" train. It's just a train. Freight engines are capable of going up to 80pm with cars, and over 100mph without (but don't for safety and operational reasons). Freight lines are designed for cost efficiency, not speeds, but generally unless your 100mph train is using specialized wheels, it will run just fine on a freight line, though it will need to slow down for turns due to the shortened turn radius on most freight lines.
I don’t think you can really compare the infrastructure freight trains use with high speed rail. Designing and maintaining a rail network where trains go at up to 350kph is a much tougher job.
So, I’d argue the US rail infrastructure isn’t even close to being one of the best.
But in a nutshell: (a) the US rail system is cheaper. The entire freight rail system costs less than what France pays for its significantly smaller system each year, (b) more throughput. Millions of tons of goods travel by rail every day. It's cheaper, faster, and more ecologically friendly to ship by rail than by air, water, or truck, (c) America's rail system is designed to withstand weather features that would obliterate most of Europe's rail lines, like tornadoes and hurricanes.
The U.S. has the world's best designed and maintained rail infrastructure. It's simply that, unlike every other country with a national rail network, America's rail system is designed for freight traffic, because now and historically passenger traffic in America has always been such a small portion of trips that it has never been worth the investment to prioritize people over goods. If transporting people had ever been more profitable than transporting cargo, America would have more rail lines dedicated to transporting people.