Much of the relevant land in the mountainous parts of the Western US is owned by the federal government so I'm talking mostly about the actual construction costs. Unfortunately, the high speed rail is useless without tracks to and from the mountain sections so the cost of obtaining right of way still matters. From my understanding, the Swiss tunnel is an extension of an existing network, so the 36 miles of tunnel didn't depend on lots of new above ground construction and the risk that comes with it.
For example, the interstate 70 expansion through the Rocky mountains that connected the western and eastern halves of Colorado cost $800 million per mile for 12 miles, even though all of the land was already owned by state and federal governments. There was little opposition, it was badly needed, and the project went very well (winning several awards) but it still cost over 40 times more than initially predicted because it turned out that building a massive highway through the Rockies was a lot harder than anyone had thought.
I suspect some form of rent seeking (or likely multiple layers of rent seeking) is part of the problem.