News for hackers. Stuff that matters.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by jrehor on Monday November 17, 2014 @03:15PM (#8620241)
I don't understand this article at all. The pension fund uses block trades. Who takes the other side of those trades and how are they compensated?

I suspect that an equity desk takes the block, parcels it out into lots of small pieces, and works the market to get it off their books. Of course, they charge for that service, both in commissions and spread. So effectively, instead of paying HFT firms for providing liquidity, they're paying an investment bank equity desk. Does this really save money? If it does, why all the hoopla about HFT if you can avoid them by going through an equity desk?

Don't tell me that they just put their block on IEX and the tooth fairy fills it without price impact. That would be some serious magic.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by wdewind on Monday November 17, 2014 @03:30PM (#8620330)
I agree with you, and I think the author, like most people who are writing against the "flash boys," fundamentally misunderstands what's going on.

I think the "black and white" rule that the large firms who feel they are being hurt by HFT want is the ability to execute a full trade before it impacts the market (since otherwise it's impossible to describe the exact moment they feel their trade is a signal to be traded off of). I think that's highly unreasonable, but if you do believe that I think IEX is probably relatively successful at it. It's totally possible that a block could be fully sold off on IEX before the 350ms latency allows that information to escape to the outside world and be traded against, no? Market impact is ultimately about the same, just delayed enough to allow the seller to escape.

I would happily be correct on any of this, since I don't work in finance.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by jrehor on Monday November 17, 2014 @03:52PM (#8620467)
It is possible that a block would be sold within 350ms, but how likely is it? That's a function of block size. If you have 100 shares, you'll get it done 100% of the time. 1,000 shares? Somewhat less than 100%. 100,000 shares? Rarely.

These guys are ginormous. $100m block is about a 0.01% position for them. You can't just put a limit order on IEX (or any other exchange for that matter) when you're dealing with this magnitude. You need a team of specialists working full time disguising the order and parceling it out to multiple venues, and it will usually take days to get it done.

The other way of moving a block this size is by finding a natural counterparty and negotiating a deal directly with them. The trade will then get booked through a broker-dealer for reporting and settlement purposes. Those kinds of negotiations take days, too, and you can't avoid showing your hand. Plus, it's not a very scalable solution.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:35PM (#8620358)
IEX only delays the order entry side of the system. Market data (they are dark atm so no quotes/book feed of course) and trade reporting is not delayed. The magic shoe box is there to stop a very specific situation from occuring: IEX pricing pegged orders against stale market data.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by wdewind on Monday November 17, 2014 @03:43PM (#8620416)
So I don't fully understand what IEX does then. Let's say A puts 500 shares of AAPL onto IEX at $100/share, and B puts a buy order in for 500 shares at $100/share, but in between posting the BUY and the order executing (in that 350ms), they get more information, and decide they actually want to pull out, are they unable to?

Let's say B instead only buys 250 shares, what happens to the remaining 250 shares?

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:57PM (#8620506)
They are unable to do so. It is a queued system with a fixed transit latency through the queue of 350us. Any remaining un-executed of A is left on the IEX book.

IEX has this transit latency because they have order types that offer pegged execution, i.e. midpoints. A midpoint order is executed at the midpoint of the prevailing NBBO. The data required to build a view of the prevailing NBBO comes in from all other lit venues.

IEX has a 350us delay because they want to slow down the order entry side to give themselves enough time to make sure they are not pricing their pegged orders using stale market data. Simple as that.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:55PM (#8620490)
It's 350us btw. Micros.... not millis.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:37PM (#8620373)
Sell side traders or block crossing networks (where the other side is taken by another block trader).

Sell siders are compensated because they will build into the price the expected impact. The pension fund gets a known price impact with essentially 0 variance and the sell sider takes on the risk of execution to offset the trade, and essentially earn a spread between what the pension fund paid them for the risk transfer and their 'skill' in getting the trade done in the market.

It obviously can and will be more complicated than that with varying benchmarks and compensation schemes, but that is the jist of it.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by jim_greco on Monday November 17, 2014 @03:39PM (#8620386)
Very odd indeed. This is a complete regression to how the market was traded 20 years ago when every bank used to have a NASDAQ market making desk that would make a principal market in any security you wanted. Those desks all got wiped out when spreads collapsed because HFT firms could do it for a fraction of the cost.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:41PM (#8620405)
They had a big hand in wiping themselves out when they got caught colluding.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by tptacek on Monday November 17, 2014 @02:10PM (#8619845)
Galactically enormous state-sponsored buy-side firm thwarts tiny sell-side firms. Implications for broader market contemplated.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:33PM (#8620349)
Look, all this guy is saying is that he is paying someone else to take on the risk of executing his large orders. Block crossing networks and sell-side traders have existed for a long time. Hell, that's what Brad (IEX CEO and Flash Boys protagonist) did prior to starting IEX. This guy is saying: rather than use an order execution algo to get my trade done, I'm just doing a cross upstairs with some sell-side guy, paying them a known amount, and letting them deal w/ how to handle it on their side.

They aren't outsmarting anyone. They're simply transferring execution risk, and they pay handsomely for it, trust me.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by wdewind on Monday November 17, 2014 @03:47PM (#8620432)
So why do they care so much? Are they literally paying more because the idea of HFT burns their cookies?
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:54PM (#8620481)
Because they suck at technology. Its easier and more justifiable to pay someone else to take on the risk and pension fund gets less variance in their execution costs.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by encoderer on Monday November 17, 2014 @02:32PM (#8619968)
Everybody always cries "front running!" I believe front running is an overblown issue. I also believe that most defenses of HFT as "liquidity providers" overlooks a large share of prop firms and hedge funds using HFT for speculation and are not in fact liquidity providers.

But the firms that do play liquidity -- the firms that compete with one another for your order after it comes thru your broker -- aren't hurting anybody by front running. In fact, they value your order flow so much (for their own info) that they price-improve for you so they capture more/all of the order. IIRC over 60% of stock trades are price-improved.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by tptacek on Monday November 17, 2014 @02:37PM (#8620003)
As I understand it: provision of liquidity is not a function of intent. Liquidity is a property of the market, not of a trading strategy. Some strategies (happen to) add (sell) liquidity, and some remove (buy) it.

The term "front-running" is terribly misused in these discussions (I can't tell from your short comment if you were, though). You "front-run" someone if they reveal their trading intent to you, and front-running usually involves an agency problem (ie, your broker and their responsibility to you as a client).

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by encoderer on Monday November 17, 2014 @03:52PM (#8620466)
The point about "front running" being misused correlates with my point that every time HFT gets discussed, ppl cry "front running" and blame HFT for various ills.

About liquidity providing... brokers don't generally route orders directly to an exchange. In most cases your order will get routed to a 3rd party liquidity provider, a firm who agrees to buy at the bid and sell at the ask and do so quickly. Often, these guys will pay the broker for order flow or price-improve your order to capture all of it, or both. Competition between these firms goes a long way towards guaranteeing the NBBO price that your broker is obligated to provide.

Connecting the dots leads you to a conclusion that the order flow is valuable enough to them (for purposes of their own prop trading, strategic option selling, etc) that they act as market makers.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by chollida1 on Monday November 17, 2014 @04:14PM (#8620624)
Some of this seems wrong.

> In most cases your order will get routed to a 3rd party liquidity provider,

This is only true if you are a regular person, ie using IB to buy in your rrsp or ira account. Almost exclusively, anyone who is a professional will go direct to market( DMA). They will never go through Citadel or some other liquidity provider.

> Often, these guys will pay the broker for order flow

Not often, always. They always pay for this, there are no freebies:)

> a firm who agrees to buy at the bid and sell at the ask and do so quickly.

If you can find someone who will guarentee that they will fill my buy orders at the bid and sell orders at the ask, please let me know and I'll give them all my flow:)

> Competition between these firms goes a long way towards guaranteeing the NBBO price that your broker is obligated to provide.

What does this even mean, even without someone buying your flow you are still guaranteed to get the NBBO price, RegNMS says this is the law. Let me be clear, 3rd party brokers have no part in guaranteeing you get the NBBO price. The law says if your order can trade at the NBBO, it must.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by encoderer on Monday November 17, 2014 @04:42PM (#8620828)
I'm not a fan of the point-by-point redressing so I'll just say a few things and leave you the last word if you want it. And I'm sure that there are some fascinating differences when trading as a hedge fund, and maybe you can share more about them. The process I laid out is generally "how orders get filled" for just about everybody reading this. If you know enough about how your specific orders get filled, I suppose you're not the audience I was writing for.

1. Brokers don't only send orders to 3rd party market makers because they're being paid for order flow. You're right, they won't get order flow for free, but I didn't mean to imply that they did.

2. Quoting and buying at their published bid/ask is precisely their function. Possibly we're just disagreeing on terms. The SEC's website is fairly good at explaining this flow. http://www.sec.gov/investor/pubs/tradexec.htm

3. What I'm discussing is the actual mechanism for HOW nbbo is fulfilled. Competition in the marketplace -- third party market makers and arb firms -- absolutely play a role in ensuring the efficiency of the market. If brokers had to run this infrastructure themselves, it would be non-trivial and without any financial incentives that I can think of.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by PhantomGremlin on Tuesday November 18, 2014 @01:57AM (#8622747)
> Quoting and buying at their published bid/ask is precisely their function

I think he was making a little joke about this. He said:

   fill my buy orders at the bid
   and sell orders at the ask
I'm with him, I'd give all my business to someone who could do that. I could retire in one trading day if I could find someone to do that for me. This was exactly the downfall of Knight Capital Group. It only took about 45 minutes for them to lose $440 million.[1]

Of course, that wasn't what you originally said, which was

   a firm who agrees to buy at the bid
   and sell at the ask
hence the smiley at the end of his comment. There's a difference between "buy at the bid" and "fill my buy orders at the bid". :)

[1] http://en.wikipedia.org/wiki/Knight_Capital_Group#2012_stock...

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by hnnewguy on Monday November 17, 2014 @03:24PM (#8620296)
>front-running usually involves an agency problem

Historically, in the HFT world, it also involved getting ahead of big orders in the order book by taking advantage of how orders are systematically queued or prioritized.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by tptacek on Monday November 17, 2014 @03:24PM (#8620300)
How does that differ from the way every market maker deals with informed traders? (Serious question, not a challenge.)
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by hnnewguy on Monday November 17, 2014 @03:35PM (#8620357)
Well, this is merely a hobby interest to me, and it's a been a while since I read 'Dark Pools' but: it's less "using information" to front-run, and more "taking advantage of computational glitches" to jump the queue and get higher priority in the order book.

I have no idea if this is still an issue (doubt it), but it was in the early days of HFT. Anyway, I'm out of my element...'Dark Pools' is a decent read if you're into this stuff.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by tptacek on Monday November 17, 2014 @03:37PM (#8620368)
I like _Dark Pools_ ('kasey_junk recommended it as an antidote to _Flash Boys_) too. For a slightly older but more authoritative nuts-and-bolts explanation, and surprisingly well-written, Larry Harris _Trading and Exchanges_ is basically the _TCP/IP Illustrated_ of money.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by wdewind on Monday November 17, 2014 @03:25PM (#8620302)
I don't want to seem pedantic, but it's explicitly not front running, despite this articles misuse of the term. Front running is when you trade in front of your clients' trades based on the information they provide you, not your competitors'.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by snowwrestler on Monday November 17, 2014 @03:22PM (#8620290)
Speculation is providing liquidity. I don't understand how you could do one without the other.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by encoderer on Monday November 17, 2014 @03:56PM (#8620496)
> Speculation is providing liquidity.

Right, but the inverse isn't true. Not all liquidity is speculative. And third party market makers are surely making money from providing liquidity but not by taking the other side of a trade.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:39PM (#8620385)
Since Flash Boys keeps coming up in these threads I want to provide an alternate reference for those curious. A recent rebuttal has been published called "Flash Boys Not So Fast". If you're interested in the topic, I highly suggest you pick it up. http://www.amazon.com/Flash-Boys-Insiders-Perspective-High-F...
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by chollida1 on Monday November 17, 2014 @04:07PM (#8620578)
I posted that book awhile ago.

https://news.ycombinator.com/item?id=8577237

It didn't really get any attention.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by fleitz on Monday November 17, 2014 @02:44PM (#8620042)
“We’re trading less using algorithmic trading now than we did some years ago and are doing much more trading in large block sizes to avoid pattern-reading.”

Interesting... given that large blocks are what HFTs feed on.

How exactly is a party suppose to drastically increase supply / demand for a stock without impacting price?

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by _delirium on Monday November 17, 2014 @03:26PM (#8620312)
It's hard to tell much in detail about their reasons from the article. I read it as just a change in tactics in how they move large blocks of stock. They seem to feel that, currently, moving a large amount of money using their previous algorithmic strategies has become too easy for other traders to read (perhaps also algorithmically), and then interfere with in ways that are detrimental to their trades. And they believe that negotiating large outright block trades is a better strategy in the current market, given their current goals. Maybe true, maybe not; it seems like a very fact-specific decision, hard for someone without the data to evaluate just from general principles of markets.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by jeffreyrogers on Monday November 17, 2014 @02:38PM (#8620008)
Managing that much money must be an enormous challenge since there are so few places where you can put a substantial amount of it.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by PhantomGremlin on Tuesday November 18, 2014 @02:30AM (#8622824)
They could be putting substantially more into real estate. They're at 5% allocation, which seems low to me. I suspect that in the USA, most people are at either 0% (renters) or 50%+ (homeowners).
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by phaefele on Monday November 17, 2014 @02:05PM (#8619823)
Content free - there is really no information in this article outside of the fact they say Norway's Sovereign fund use "Block Trades" which is really what dark-pools are supposed to be all about. Dark pools and block networks have been around for at least the last 5 years, and introduce their own set of issues (not getting your orders filled, showing Goldman Sachs your order on their promise that they won't don't anything with that information :-)
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by yummyfajitas on Monday November 17, 2014 @02:22PM (#8619910)
Well, they do point out why you don't want to be a little player on IEX:

“Trying to find liquidity without having an impact when you’re doing it is an over-arching challenge we will always have,”

Huge players don't want to have a price impact before they trade - they want the price impact to happen after. I.e., it'll happen to the little guy rather than to them.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by tptacek on Monday November 17, 2014 @02:11PM (#8619856)
A block trade is simply a large coherent set of orders; it's the purchase or sale of a big number of tradable instruments, which usually requires a lot of little orders to execute.

This is pure pedantry on my part, but I wouldn't want the thread to leave the impression that "block trades" are some technological feature of electronic markets. They're a fundamental problem of trading.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by jellicle on Monday November 17, 2014 @02:31PM (#8619959)
"But flash trading isn't about front-running" -- standard HN apologist
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by tedunangst on Monday November 17, 2014 @02:34PM (#8619981)
"I have no idea what front running actually is" -- standard HN complainer
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by TrainedMonkey on Monday November 17, 2014 @03:10PM (#8620204)
When a large buy order comes in price rises. Front running would be buying before that large order can execute, and selling immediately after it completed and moved market price up.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by lrm242 on Monday November 17, 2014 @03:27PM (#8620316)
Wrong. Front running has a very specific definition and requires a broker to be acting on behalf of a client.

1. Broker takes client order.

2. broker trades his own account first (with knowledge of client order)

3. Broker executes client order.

If you don't have clients you can't be front running. It is black and white and as simple as that.

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by Retric on Monday November 17, 2014 @04:41PM (#8620821)
Wrong

It's also Front running and illegal to pay a Broker for prior knowledge in front of their clients trades.

Also, the term may apply to using insider knowledge. Khan & Lu (2008: 1) define front running as "trading by some parties in advance of large trades by other parties, in anticipation of profiting from the price movement that follows the large trade". They find evidence consistent with front-running through short sales ahead of large stock sales by CEOs on the New York Stock Exchange. http://en.wikipedia.org/wiki/Front_running

" "Front running" is sometimes used informally for a broker's tactics related to trading on proprietary information before its clients have been given the information.

For example, analysts and brokers who buy shares in a company just before the brokerage firm is about to recommend the stock as a strong buy, are practising this type of "front running". Brokers have been convicted of securities laws violations in the United States for such behavior. "

Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by tedunangst on Monday November 17, 2014 @05:09PM (#8620999)
Calling all insider trading "front running" does nothing but muddy the waters.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by Retric on Tuesday November 18, 2014 @12:12AM (#8622470)
Not all insider information, just insider information about large pending trades.
Re:Norway Wealth Fund Outsmarts Flash Boys as Algorithms Aba... by RickHull on Monday November 17, 2014 @03:27PM (#8620318)
This is incoherent for a single order. When the first order hits the books, a subsequent order has no opportunity to execute before the first except at a price disadvantage. Front-running typically involves an agent (i.e. a broker) executing on behalf of the principal, where the agent makes his own trade first, moving the market against the principal, and only then executing the principal's trade. Notice: two orders.

This is not a problem when the principal has an exchange seat and may execute directly. Where firms are performing multiple-exchange arbitrage, and the principal splits a large order into several for execution across multiple exchanges, there is now an opportunity for something like front-running: the arbitrage firm can detect the principal's intent from the first order to hit the first exchange, and then try to move the market profitably (against the principal) on the other exchanges before the correlated orders can execute. While somewhat analagous, this activity should not be referred to as front-running.