There is a saying in the Beltway, "those who talk don't know and those who know don't talk." The same is probably true in this line of business.
It is hard to determine whether our financial markets do enough/too-much of whatever it is that tier-one liquid market buyside quants do. They probably do a lot more than you'd expect.
"brokers and exchanges are much worse [than DE Shaw] since they're fiduciaries and semi-regulatory entities, respectively, and riddled with conflicts of interest."
Some basic arguments against are:
1. They are providing a service that adds no (or at least dubious) value to society. And again, I do think it's possible to have highly liquid, highly efficient markets where the amount extracted by prop trading firms is much smaller. But you're right that's an arbitrary statement, and who am I to say it's not already down to a reasonable level. 2. They do extract a lot of value. Maybe they're just siphoning it from banks and other hedge funds, in which case kudos (not to pick on hedge funds - they're just not a sympathetic victim). But probably at least some of it is extracted from mutual/index funds, pension funds, etc. Not the worst thing in the world and good on them for figuring out ways to make money, but it doesn't feel great. 3. Opportunity cost to society of the brilliant folks who wind up working there. Meh.
Way less bad than conflicted parties hurting their clients for their own gain. But I don't think they should be glorified either.
How exactly do you decide how much is necessary?. And is there any reason to think that they are extracting value from society rather than other market participants?
And is there any evidence that having one company make a billion dollars from other market participants is somehow worse for the system than having a million companies make a thousand dollars each?
The low spreads and liquidity are not some fact of nature - I’m pretty sure that a lot of it comes as a result of many people competing with each other to try and make money. I agree there are lot of people trying to screw their clients to make money in both the retail and the institutional markets (I used to work in sales for an I-bank). And I agree that those areas with conflict of interest are badly policed and do NOT help market structure or society as a whole. But my impression is that DE Shaw is a prop trading firm - where is the conflict of interest?