Airlines increasingly wanted to grow the flying population, by lowering prices. More people have access to airplanes now, and so they have turned into what was traditionally the service and experience of a bus.
We would be so lucky if flying had the service and experience of a bus!
If you upgrade enough to private then you can get the flying experience of the 50s: Small Planes, no security, walk on the tarmac.
It's like paying more puts you further back in time.
I don't live in the US but I remember when flying last year there were few sectors in which there was only one airline operating (if memory serves right, there was just United between Las Vegas and SF). So, even if I'm disgusted by the way United treats its passengers, I have no choice.
The little that I've understood of airlines and their economics, I think the best way out is to nationalise all the airlines and let them be run as a public utility. Introducing capitalistic principles has either kicked off a race-to-the-bottom on prices, miles and treating customers like cattle.
The last few mergers shouldn't have been permitted.