It's super annoying. I hate to fly - well, that's not true; I hate the pervasive unpleasantness and inconvenience of US commercial air travel - and find trains much more congenial, but e.g. two days to get from where I live to where I grew up, plus two more days to get back, is more travel time than I can afford.
Unfortunately, while we have an activist billionaire interested in trying to improve this situation, he appears to prefer vacuum-tube moonshots, starting in the country's best-served and most infrastructurally complex transit market, to doing anything useful right now. So it goes.
There are a couple of routes across the country, stopping roughly once per state if that. As you mentioned, it's freight with a few passenger trains sharing the tracks.
In addition to the northeast region (DC, Philly, NYC, Boston) you can do pretty well in Chicago. It's the hub of all of those routes except for the one on the US/Mexico border.
Amtrak's sleeper cars are also quite expensive when I last looked at it as an option for getting from Colorado to San Francisco. The price compared to a seat on the train was 2..3x or more (but it includes food).
Since that would be wasteful, Amtrak doesn't do it; instead they stop in San Jose (where you can switch to Caltrain to run up the peninsula into SF) and Oakland (where you can hop on BART or a ferry to cross the Bay into SF).
Just to be clear: not knocking Amtrak here. They're virtually budget-less, for the most part disallowed from owning or even maintaining their own infrastructure, so building new infrastructure would be completely beyond the Pale. Not knocking Amtrak at all -- it's America's collective ability to get its infrastructure act together that is just sad.
> Because it is a suspension bridge and has similar coloring, it is often compared to the Golden Gate Bridge in San Francisco, US. It was built by the American Bridge Company which constructed the San Francisco–Oakland Bay Bridge, but not the Golden Gate.
First the Cumberland Valley Railroad in 1839, then George Pullman's more luxurious version in 1865 that was very successful (and from there, it spread to Europe).
Not exactly the ritz, but does the job: https://www.google.com/search?tbm=isch&q=sleeping+train