That said, you're still playing a zero sum game with other mom & pop shops and the general large-scale movements of the market. You need to be confident that you have better information / forecasting ability than the others, or technology infrastructure that enables strategies no one else can execute.
Source: I work in the industry.
I find it extremely unlikely (almost inconceivable, in fact) that a hedge fund would divert 10 researchers to work on a trade with $20m of potential upside.
I expect this to replicate itself on the low-end as well.
I mean, trading in paper without any insight into the capital allocation the paper is abstracting, and observed over a very short time horizon, it's more or less zero-sum. Many synthetic products just distribute risk differently. Etc.
But finance more generally is helpful for efficiently allocating capital towards wealth generating industry - and by industry I mean it literally, people physically doing things, creating things, generating wealth by the sweat of their brow. When you own a share of a wealth-generating enterprise that grows in value, you're acquiring some fraction of the discounted future returns on that effort today. This isn't zero-sum; it's a slice of tomorrow's wealth, today. And it's backed by real action, actual things, products and services that you can use or exchange with other people for things you prefer more. These are things that didn't exist before the capital allocation, and may never have come about without it.
You probably know this already, but I'll provide some more context for the interested:
In reality, two parties can walk away from a trade believing (in the moment) that they got the better deal. Otherwise, they wouldn't be trading in the first place. This results because people have different utility functions. A farmer might be willing to buy insurance that gives him negative expected value, because his utility function incorporates a larger risk term than the insurer. A fur trapper sells furs to a buyer because 1 pelt is not scarce to him. With derivative contracts this analogy gets a bit abstract, but the justifications hold.
Liquidity providers add liquidity to the market precisely because they think that the rebates are "worth more" than the liquidity they are providing. A liquidity taker might still fill their trade because they have a different utility function. The net gain for society would be the net gain in total utility, if we were somehow able to convert them into normalized units.
However, if the liquidity taker is a nearly identical firm with a nearly identical utility function, then that implies that the liquidity provider and taker disagree over who is on the losing side of the trade. One party has better information or luck than the other and the future eventually reveals which was the better choice.
To put it another way, I believe it is a zero sum game if players with identical utility functions (i.e. two small prop shops with $200K book) trade with each other. Both probably have identical utility functions, and future events will reveal whether buying or selling was the correct choice in terms of utility. There are quite a number of such players swimming in the market, so there is a zero-sum game of "who knows more" that goes on underneath the actual net utility provided by liquid markets.
In reality, two parties can walk way not just believing, but actually getting the better deal. Both parties can be winners, there is not always a loser when a trade is made. One guy could be exiting a long while profiting taking while the counter party is opening a short, and they can both bank profit from the trade. Maybe one is hedging and doesn't mind if the trade goes against him because it's hedging another trade in his portfolio to keep him market neutral. The idea that one guy wins and one guy loses is simply far to simplistic.
As a fund owner, you know the magic formula: If your fund customers win, you win, if they loose, they loose.
It's a good position to be in.
For instance, imagine you have a poker-playing bot at a poker table, where the house takes no cut of the stakes. Zero-sum? Yes. But your bot has to be better than the other players, and win more than its running costs in order to profit. Now imagine the same situation but the house does take a cut. Zero-sum? Not any more. But your bot still has to be better than the other players and its running costs in order to profit. The house 'rake' just increases your operating costs.
I think you are confusing the issue with large scale HFT (where companies pay more and more for slightly faster comms), which is a world away from the trading strategies the article is talking about.
I think the zero-sum part implies that this type of trading is not actually productive. At this point, it is literally just modifying numbers represented as fluctuations in local electro-magnetic fields instead of something useful like carrying spices from one continent to another.
It's not, because new money is always entering the system from the real economy.
For example, there is not a fixed amount of money invested in the stock market that the players just trade among themselves in a zero-sum game. Under normal economic conditions, people make money in some other non-finance industry and invest it in stocks, increasing the total pool.
If your model is long as often as it is short (either cross-sectionally or in a time series sense) then this is less likely to be a problem.
A far bigger source of error for inexperienced researchers is incorrectly accounting (or not accounting at all) for trading costs, financing costs, roll costs, liquidity constraints, data delays, market impact etc.
This has been true of markets since well before computers got involved. When thousands of atomic participants are involved, what's your edge? The truth though is that participants "cluster" and "herd", and algos do too. Witness the correlation between all the algo hedge funds. Markets are prone to group psychology. Savvy, often contrarian-minded (or at the least "independent" minded) individuals always did, and still do, have a chance, and that includes algorithmic originality.
+1, and I'll add a link that argues that data pre-2009 is worthless for a great many (intraday) strategies:
http://www.priceactionlab.com/Blog/2015/07/historical-data-t...
And this is before we even start worrying about in-sample vs. out-of-sample...!
>If you back test over the past 20 years then I'm not sure it helps much as the market of 20 years ago didn't really have any of the major market drives of today's markets, HFT's, huge numbers of hedge funds and the money they bring, and huge passive investing via ETF's, all those factors were there 20 years ago, but they weren't the major market drivers that they are now.
I imagine you wouldn't want to 'back test' over some arbitrarily selected number of years of data. You'd want an adaptive algorithm that could exploit 'trends' over any time period.
But, like someone else mentioned, backtesting is near meaningless: the only thing that matters is actual performance.
Of course that what you want, but how will you find it, and more importantly, how will you know you found it? In a bull market, an "adaptable general algorithm" that makes 10% in a year is statistically indistinguishable from an algorithm that buys and holds S&P500, unless you design your backtests very carefully.
well, giving the fractal nature of price movement, i'd guess one can backtest against last several days/weeks taken at very high resolution and scaled out to represent months/years :)
You don't. You turn it on and see if it works. Which does have a certain degree of intellectual rigor to it.
> So if you are writing your own trading models you should start by answering the question of what's your alpha when compared to everyone else....
Well right, that's the core question isn't it. But clearly the allure of wanting to test ones own set of biases and insights for alpha is fairly understandable and appealing.
How do you back test it to know that it works. If you back test over the past 5 years then you are only testing your model against a huge bull market.
If you back test over the past 20 years then I'm not sure it helps much as the market of 20 years ago didn't really have any of the major market drives of today's markets, HFT's, huge numbers of hedge funds and the money they bring, and huge passive investing via ETF's, all those factors were there 20 years ago, but they weren't the major market drivers that they are now.
So for back testing you are damned if you do and damned if you don't:(
I think I've said this before but in my experience, a decent trading system is 70%+ market insight. And there are only really 3 ways to get this insight, hard earned experience, applying new streams of data to the markets and applying math to existing streams of data to unlock new insights.
All 3 are being done every day by scores of MIT Phd's.
So if you are writing your own trading models you should start by answering the question of what's your alpha when compared to everyone else....