I can see this claim being plausible concerning short distance rail, i.e. "don't build a train to the ghetto", however.
I can't say I've ever seen much of the thug life on Metra trains, though.
Just checking prices it's about $10 more to fly round trip from Omaha to Denver vs. going from Omaha to Denver by Amtrak. The plane ride (including travel to/from the airports) would probably cost me about 4 hours of my life each way while the train would be over 10 each way (this is a trip I have made before).
But that is a simple example where there is a direct route by both modes of transportation. Lets say I'm going to take the family to Orlando for vacation. By air is about $60 per person more expensive than by train BUT the trip by air will take about 8.5 hours while Amtrak will take 53+ hours EACH WAY!
Rail doesn't get anywhere in the U.S because generally it doesn't go where you want by anything like a direct route so it takes a significant portion of your life in travel time.
I don't think any HSR advocates really believe something like cross-country would be viable. This would be more like (as it is currently) NY-Washington DC.
The class differences in the United States are far more extreme than most people realize, mostly because people stay inside their tight little class bubbles all day long in their private cars, driving to work and back and rarely venturing out to get a latte every once in a while.