Say you want to buy your 3000 shares, and you don't want to spend more than $20/share, so you enter your bid with a $20 limit. Your limit is supposed to be invisible to the market, only you and your dealer know it. But the HFT algorithms have a way to probe your order and uncover your limit.
The stock is currently trading around $15, so your order hits the exchange, and in the first few milliseconds, a HFT computer makes a micro-offer for 10 shares at $16, then 10 shares at $17, then 10 shares $20, then 10 shares at $21.
When the last offer is rejected b/c it's over your limit, the computer then guesses your limit is $20 and offers to sell you 2960 shares at your limit of $20.
All this happens in just a few milliseconds, and it just cost you roughly (2960x20 + $20 + $17 + $16 + $15) - (3000 x $15) = 59,268 - 45,000 = $14,268. That's 30% more than you would have paid had you been able to execute at $15.
It's basically cheating, and should be made illegal. Just one more example of how our markets are rigged.
Remember, the price is a two-way street. It's what you are willing to pay, and it's what the seller is willing to sell for. If you say, "I would like to buy at $20" and your partner says "$20 is fine with me too", and the trade happens at $20, then the market is working perfectly. You could have gotten a better deal, but it's not what you asked for.
Meanwhile, some even smarter guys at an investment bank just down the road know all these tricks, too, and have come up with a way to algorithmically spot them happening more accurately or more quickly than anyone else. So they start jumping in front of your trades, not because they want the stock, but because they know you want it and are probably willing to chase a rising bid for a while. Then all the other algorithms start to notice, and they start doing the same thing.
You, the friendly investment manager, are now financing both sides of what really amounts to one of the coolest deathmatches going, a bunch of math and computer geeks playing on your quarter and keeping a penny for the honor of letting you watch them do it. But you actually don't care, because it wasn't your quarter in the first place, and now that your fund is back in order, you're not going to get sued, and your customers, who had no idea that any of this was going on, and who may not even realize they're your customers, are back to paying 2% fees for (statistically likely) below-market returns.
In the past, these kinds of large trades would usually end up splitting the difference, with 'real' sellers earning a bit more than what they would have otherwise settled for and 'real' buyers paying a bit less than their actual ceiling. But now 'real' buyers end up paying close to their high bid, and 'real' sellers end up earning their low ask, with the bots fighting it out for the very thinly sliced middle territory.
In one sense, I do agree that this is an example of a market working perfectly. Algorithmic traders are exploiting an arbitrage opportunity between mainstream industry practice and cutting edge technical ability, and just like theory would suggest, they're making bank from it.
I think this is all there is to be said. Your trading has a pattern that makes them money. The algorithmic traders are going to use that information advantage to make money. That's the idea of the market; trying to extract as much value from securities as possible.
Even if you impose arbitrary trading limits, the big banks are still going to find a way to make money off of you.
However, he basically has the ability to read your mind and see that he can negotiate you up to $20, while you lack the same ability to reciprocate.
It's an unfair advantage enabled by large firms having the money to buy better access to market mechanisms and powerful enough computers to exploit them.
EDIT: Before you go on to say that football and investing are two very different things, let me state that I am fully aware of that. I've had that conversation before when this topic comes up. Common people are able to participate in the investment process while only a very few get to play in the NFL. The people that are upset are the ones that try to game the market themselves but are under-capitalized. From prior conversations, long-term investors simply don't care about these things. The people all up in arms are the one's that have lost money because they are trying to do something they are not in a position to do. I'm only talking about trading stocks and futures here; the more advanced investment products, like CDOs and CDSs, and the issues in the news regarding them, are a totally different conversation.
Participants getting exploited withdraw and find other ways of getting what they need, most recently through dark pools.
Crucial liquidity diminishes, and eventually all that's left are the crooks. The suckers are broke and honest non-suckers are gone.
If you want functioning capital markets, you have to regulate and crack down on stuff like this.
The market is supposed to be fair and a level playing field for all those who can afford to buy stock, but the HFTs tilt the odds in favor of the select few.
When the odds are tilted in favour of a select few, it becomes a problem for all. The bond markets are far less regulated, thereby allowing Wall Street to profit massively from confusion and a lack of regulation - Wall Street makes most of it's profits on the bond market. The result is that insane toxic assets get sold, all because the industry can supposedly self-regulate. Result: global catastrophe. (See "The Big Short" by Michael Lewis for a great read on how Wall Street caused the financial crash of 2008).
The flash crash was exacerbated by HFT, not caused by the absence of it.
Congress doesn't have to outlaw HFT, but it does have to outlaw HFT order limit probing. Though it would probably not hurt to completely unplug HFT anyway.
There is zero net benefit to the markets from it, and there will be plenty of trading and liquidity without it (just as there was before it). Arguably even more, as funds that now resort to dark pools return to the open markets.
Volatility spikes would still exist (always have always will), but HFT exacerbates them, lack of HFT mitigates them.
The problem with HFT is that it is not a productive enterprise. It does not take raw materials like copper and sand, and apply labor, capital, and innvotation to turn them into products worth more than the sum of their inputs, creating real wealth. It doesn't mine or farm those raw materials. It doesn't even provide a specialized service that saves people time/money.
All it does is skim off the top of the global capital flow, increasing the cost of that capital to everyone else, particularly to the productive enterprises mentioned above. It is parasitic, and gives nothing back, despite the 'story' Wall Street has created to justify it.
It doesn't even provide a specialized service that saves people time/money.
You are so far from reality here. Do you understand what the futures markets are for? Do you understand that there are a whole class of speculators, among them are HFT firms, that stand ready to do business with a farmer growing corn, a gold miner mining metal, a cattle producer with cattle to go to the market, etc? By providing liquidity, the farmer can focus on farming, the miner can focus on mining, and the cattle rancher can focus on ranching (whatever they call it) instead of worrying about what they may sell their raw goods at in the market four, five, or six months from now. So, no, I am not out in the fields digging up copper and sand, but I, and others in the industry, make it possible for those that do those things to focus on doing those things. If I figure out a way to make some extra money by using mathematics and computer science, then so be it.
We should cease all activities deemed "non productive" by the state and get back to work in the mines.
If anyone out there had a sell order at less than $20, their orders are immediately matched to yours. Lets say someone wanted to sell 1000 shares at $15.1, someone else 500 shares at $15.2, and nothing above that. So you just bought 1500 shares at $15.1 and $15.2. Now there are no shares available to buy below $20, but your order is only half filled.
What happens next is that an HFT system will rush in with a sell order of 1500 shares at $20.0. Your order is filled within a second, and at the price you asked for. Without the HFT system, you'd need to wait a few seconds for a human to come along and fill your order at $20.0.
Now, there are certainly means of hiding one's intention. There are also means of finding out where hidden liquidity exists. I will admit to that. Look up icebergs and strategies to detect icebergs. Just because people attempt to hide their intentions while some try to discover those intentions, that doesn't mean there is anything suspect taking place. Information, or the lack of information, is important.
Under normal market operation, sometimes the market will trade upwards during the time it takes to fill your order and you'll pay in a range from whatever the market started at up to your limit.
Sometimes the market will trade down during the time it takes to fill your order and will never hit your limit, especially if you make the order while there are more sellers than buyers (say BP after the accident).
So over the course of many trades you may be able to expect average execution prices around where the market was initially trading when you placed the order, since sometimes you'll pay nearly exactly that, sometimes you'll pay more, and sometimes less.
But as these HFT limit probing scams become more widespread, execution averages will skew toward being more expensive for the party on the other side of the trade from the HFT, which is typically big mutual and pension funds that deal in millions of shares, or Joe Six-Pack buying through some less-sophisticated Etrade or whatever.
You have to specify more exactly what you mean when you say the current price is $1.92. Is it the current best (highest) bid, best (lowest) offer, or last traded price (this is generally the displayed price, but there is no guarantee that you can buy or sell at that price, since that depends on current outstanding offers and bids.
Suppose the last traded price is $1.92, and the current best bid (highest price anyone is willing to pay) is $1.90 and the best offer (lowest price anyone is willing to sell) is $1.95. You can either decide to buy from the best offer or bid higher than the current best bid and hope to find a seller.
Where HFT comes in is in that the increased amount of money and number of participants in the market tends to cause the difference between the best bid and best offer prices ("the spread") to go down, making it cheaper for everyone to enter and exit the market as they wish. This is the market making effect hugh3 referred to above.
Please note I am not an expert and may turn out to be wrong on some of this.
cf.: http://www.businessinsider.com/john-carney-matt-taibbi-falls...
There was an article on this a few weeks back where a guy in the know was explaining how such systems are a bad thing. Say you bid a price of $2 per share for a share that is currently at $1.92. Since the advent of HFTs, there's a much higher probability that the price you eventually pay will be a lot closer to $2 than to the current $1.92, (perhaps $1.98 or $1.99) whereas before HFTs you could get it closer to the current price. This matters particularly when you buy a lot of shares, and when you hold them for a long time, as the couple of cents difference compounds a lot over time.
I'm not an expert on the subject, that was my takeaway from it.