NYC to Philly - 95 miles
NYC to Washington DC - 225 miles
NYC to Boston - 220 miles
Washington to Bostin - 420 miles
Not in my experience. I took Amtrak from Atlanta to DC in 2008, and it was basically a 13 hour flight -- same kinds of seats, only marginally more space, and the food service amounted to paying exorbitant prices for awful sandwiches that could have been vended from an office machine. I would prefer to spend 10 hours in an airport and 3 hours in flight, given the chance; airports are at least quite comfortable, in general.
The times I've taken Amtrak (mainly for amusement value; Seattle-SFO and SFO-DEN), it was mainly old people (many of diminished mobility), some religious groups (mormons? menonites?), and foreign tourists. And mostly empty seats.
Amtrak is expensive because it's expensive. It bills its sleeper service as a luxury thing, and charges luxury prices. There's nothing to say that it has to, or that anybody who decides to compete with them has to.
http://en.wikipedia.org/wiki/Couchette_car
proper sleeping cars where you have your own private small room are a lot more expensive.
I'm guessing it's a land availability problem: the existing tracks aren't straight enough, and building new tracks through these densely populated areas would destroy tens of thousands of homes. What we really need to do is travel back in time to 1920 and set aside some nice dead-straight sections of land for future rail works. Or perhaps we need to wait another hundred years and hope that building a 300-mile tunnel becomes affordable.
There's two big problems with air travel in the U.S. that trains could exploit.
First, most cities don't have direct connections to their neighbors. Connecting in hub airports takes considerable time and adds the possibility of additional delays. (i.e. I've got to worry about a snowstorm in Chicago if I want to travel from Des Moines to Indianapolis.)
Second, check-in, ticketing, boarding, and baggage claim are a huge pain and add an hour or two to every flight.
Trains could directly connect any number of large, close-together cities that are not currently airline hubs and provide very competitive travel times.
Kansas City to St. Louis is only ~250 miles. That's 2-3 hours on a fast train. Including check-in and baggage claim, it takes 5 - 7 hours to fly between the two cities (connecting in Chicago.) St. Louis to Cleveland is about 550 miles. That's 5 - 7 hours on a fast train. On a plane that same trip would take 4 - 6 hours including check-in and baggage claim (connecting in Chicago again.)
Even if it were an issue, people in this country are getting increasingly fed up with air travel, and they may be willing to make some trade-offs to travel in a more humane manner.
One problem is population density. The US is geographically twice the size of the EU, but has three fifths the population. Germany is the size of Montana, but has 90 million people. Typical travel distances are short, and the number of travelers on any given day is high. Fixed costs would be proportionally higher for a US service as a result.
Local transport upon arrival is a big issue. Most European cities have public transportation systems that are effective enough for large portions of the population to not own cars. This is only true in a very small number of US cities (probably fewer than 5). For many people, any cost savings from taking a train instead of driving would be offset by the cost and inconvenience of securing transportation at the destination.
A final issue is that very long distance train travel still takes a long time compared to air travel. Using a generous estimate of a 100mph average (remember, the trains have to make stops), a high-speed train would take 20 hours to get from LA to Chicago. I think few people would opt for that over a 3 hour flight even given a significant difference in price.