For M&A and IPOs it's also relatively simple; the differences in the amount of money you get can relatively easily be 20% or more depending on who's representing you. These are complicated transactions, you need a lot of expertise to do them, and you need a sales team in place to sell it, and an organisation capable of doing the research to drum up the deals. When you're dealing with huge amounts of money anyway and the top guys are vastly better than the mid market they'll be able to demand $BIGNUM because they're judges to be worth it.
2% of $100 million is a lot. If you need to pay the #1 guy an extra $100,000/year to keep him, it's well worth it.
As far as I understand it, beyond the basics of arbitrage, risk hedging and market making etc., investment banks are a zero-sum game - which after you add in the overheads and the profits, they destroy value.
My own train of thought lead in a similar direction as yours. What I'm really hoping for is the opinion of a hard core classical economist, because I feel like that's what I'm lacking. Are you familiar with such arguments? The free market determines salary, after all.
Finance as waste: There's an arbitrage opportunity somewhere worth 100,000, and it will be picked up within a week of emerging. It is privately profitable to spend up to (100,000 - trading costs) to be the first to notice this, but the social benefits of it being discovered in 2 days rather than seven verge on zero.
The former is useful to the economy, the latter is a tremendous waste of valuable human capital.
1) Officially a lot of the stuff is there for hedging/insurance.
2) It's quite hard to regulate this stuff out of existence, because the aforementioned really smart people will find holes in your regulation.
3) The financial industry is quite powerful and can hire a lot of lobbyists that talk about "improving efficiency" by reducing red tape surrounding their industry.
4) During the good times it looks like a lot of wealth is being created and no-one wants to commit political suicide by spoiling the party.
But clearly the demand for talent in banking is much higher than that. These people get paid extraordinary amounts of money. So where is that demand coming from? What service is being provided by banks that warrants the compensation?