News for hackers. Stuff that matters.
Re:At Blackrock, machines are rising over managers to pick s... by terravion on Sunday April 02, 2017 @04:50PM (#14018973)
It is interesting, but not all that surprising that ineffective management strategies are slowly being flushed out of the market. That human stock picking is pretty bad, is widely known, sorry for the pickers, but I'm sure there are other things that they can do to actually create instead of destroy value--reallocating their labor is a huge benefit for society.

The real questions for me with this transition though are:

-With all these people passively investing, are we going to see reduced competition within industries because you don't have active, non-diversified, significant, institutional shareholders to drive aggressive competition against other industry participants? In fact, we may get the opposite where institutional shareholders don't want to see aggressive competitive moves because it is profit destroying for them on both sides (aggressor spends money to return less than the defender loses in profit--lose, lose for investor in both companies win, win for the consumers of this industry).

-How good is price setting if there are less and less actively managed funds? Are there new inefficiencies that are created by all this passive investing?

-Where aren't the machines taking over? Obviously, something like replicating an index is a great exercise for automation and programming. But truly maximizing return? Who is successfully, consistently beating the benchmarks with active strategies automated or not?

Re:At Blackrock, machines are rising over managers to pick s... by Analemma_ on Sunday April 02, 2017 @05:07PM (#14019057)
There's been a lot of interest lately in the hypothesis that increased passive investing might cause non-competition as mutual funds hold shares in every company in a sector. It's now gotten a couple studies from both academia and even the Federal Reserve, and so far the evidence is that there is nothing to worry about yet. Check out Matt Levine's daily column and the "Should index funds be illegal?" section, he's been following these developments.

That doesn't necessarily mean it won't be a problem in the future. Right now the big index funds like Vanguard and BlackRock own something like 10% of public shares. If they reach, say, 50%, we might have to revisit this, but for now, it seems to be a non-issue.

Re:At Blackrock, machines are rising over managers to pick s... by Maven911 on Monday April 03, 2017 @01:36PM (#14025057)
Hi, I am curious, do you do lot's of finance type research, would like to chat if possible to learn more. P.S. Also really like Matt Levine's postings.
Re:At Blackrock, machines are rising over managers to pick s... by tormeh on Sunday April 02, 2017 @04:55PM (#14018994)
Following a market cap index investing - the most popular method of passive investing - means buying a set of stock weighted by market cap and then mostly doing nothing. It's hardly the machines taking over. Algorithm investment is probably not passive investment.
Re:At Blackrock, machines are rising over managers to pick s... by rockinghigh on Sunday April 02, 2017 @09:20PM (#14020016)
There are actually two trends: 1) Move to ETFs: Clients have been moving away from high-fee hedge funds into passive funds (ETFs) where trading is generally simpler. 2) Automation: There used to be a lot of analysts working on reports to monitor fund performance, tracking error, trading costs, risk exposures and so on. They are being replaced by software.
Re:At Blackrock, machines are rising over managers to pick s... by simo7 on Sunday April 02, 2017 @05:16PM (#14019085)
Exactly, how can algorithm investing be truly passive investing?

There's a lot of confusion in the article.

Re:At Blackrock, machines are rising over managers to pick s... by dsr_ on Sunday April 02, 2017 @06:18PM (#14019374)
Disclosure: I work for a company which does this stuff. I'm not in the financial programming side.

There are several things you can do.

For example, say you wanted to hold the S&P500, but as individual stocks rather than paying someone at a mutual fund or ETF to hold it for you. This might be beneficial in a number of ways, but it has the serious drawback of having to manage 500 entries. You might already own a dozen or two of those entries already, or you have overlapping purchases in other investments.

You could tell a smart portfolio management program to use the S&P500 list as a target, and tell it about all the rest of your current holdings. Then it could analyze your current portfolio each day and make recommendations about how to get closer to your target, while avoiding wash sales and duplicate purchases. If you trusted that program, you could feed the output to your brokerage and have the trades executed automatically. Or you could look at the output and make decisions about whether you want to make the changes. Either way, you are no longer doing analysis yourself, and you're edging closer to your target, at which point you would be passive.

On the other hand, suppose you wanted an approximation of the S&P500 -- a target that would give you most of the same exposure and opportunity, but had a reduced number of individual stocks. You could run simulations on subsets of the S&P500 until you got a group that performed sufficiently similarly to the whole thing - 300? 250? 100? 50? as you reduce the set size you reduce the fidelity of the model - and then buy and hold those.

You can do a lot with an algorithm, and if your strategy doesn't need to operate in realtime, it will certainly look passive compared to HFT bots. A human might not want to rebalance more than annually or quarterly, because it can be a lot of work -- but a robot has no problems doing all the calculations daily and looking for a sufficient reward to present to you.

Re:At Blackrock, machines are rising over managers to pick s... by simo7 on Sunday April 02, 2017 @06:26PM (#14019414)
Thanks for the explanation, there are 2 things I don't quite understand though.

What is the advantage of building a replica of the S&P500 with individual stocks rather than having it done with an index fund? Isn't the second option much cheaper?

Secondly, isn't finding a subset of the S&P500 and trying to replicate it still an active strategy?

Re:At Blackrock, machines are rising over managers to pick s... by wtvanhest on Sunday April 02, 2017 @07:25PM (#14019631)
Most investors are just like you and me. We have a basic portfolio which we needed managed cheaply.

But... huge amounts of assets are held by people/companies that may have odd holdings (ultra concentrated positions) or odd needs (liability matching). Those people/companies may need algorithms to help them move their portfolio to an optimal portfolio with minimum cost.

Re:At Blackrock, machines are rising over managers to pick s... by jnordwick on Sunday April 02, 2017 @09:49PM (#14020116)
You can actually arb the SP500 components against the ETFs like SPY in a process that creates and redeems the ETF. This is how the ETF is kept in line.
Re:At Blackrock, machines are rising over managers to pick s... by dsr_ on Sunday April 02, 2017 @06:36PM (#14019445)
I expect that there are tax advantages to holding individual stocks rather than an index fund.

Is finding a subset an active strategy? Depends. Do you do it every day, or do you figure out your subset and then buy and hold for fifteen years?

Is it passive when you rebalance against your target quarterly?

I think we can all agree that it's not passive when you are doing HFT, and anything which involves picking new stocks daily or weekly is active -- but having an algorithm do the rebalancing against your existing target daily and executing when a threshold is met? You're not making new picks, just readjusting against what you've already picked.

Re:At Blackrock, machines are rising over managers to pick s... by davenbuster on Sunday April 02, 2017 @10:22PM (#14020204)
One tax advantage to approximating an index with individual stock positions is "tax loss harvesting": sell one stock at a loss and buy an equivalent. e.g., sell Coke and buy Pepsi. An advisor told me that you can add ~1% to your after tax returns. You need sufficiently large positions such that rebalancing transaction fees are negligible.
Re:At Blackrock, machines are rising over managers to pick s... by loeg on Sunday April 02, 2017 @06:47PM (#14019476)
> I expect that there are tax advantages to holding individual stocks rather than an index fund.

None that I am aware of. Mutual funds can force capital gains realization, but ETFs do not.[0]

IMO there's no reason to roll your own index fund when you can just buy an ETF with a very low expense rate. If you have enough money that rolling your own (costs a fair amount to manage) is cheaper than the public fee, you might be eligible for a special shareclass rate anyway.

[0]: http://www.investopedia.com/articles/investing/090215/compar...

Re:At Blackrock, machines are rising over managers to pick s... by wahnfrieden on Sunday April 02, 2017 @09:50PM (#14020126)
Here's one: as a US citizen living in Canada, I'm unable to invest in ETFs in Canada (e.g. Vanguard Canada's S&P500) without suffering punitive taxes and onerous reporting to the IRS. If it's an active investment, then it's fine, it's taxed as normal.
Re:At Blackrock, machines are rising over managers to pick s... by user5994461 on Sunday April 02, 2017 @06:48PM (#14019483)
Unless you're playing with a million dollar, the fees for rebalancing are more expensive than any returns you might make. Especially if you have to trade hundreds of funds separately.

Don't rebalance quarterly either. Index funds are long term, meaning years.

Re:At Blackrock, machines are rising over managers to pick s... by astrange on Monday April 03, 2017 @02:13AM (#14020920)
Rebalancing ETFs is free or included in the price of a roboadvisor.
Re:At Blackrock, machines are rising over managers to pick s... by frgtpsswrdlame on Sunday April 02, 2017 @05:01PM (#14019025)
>With all these people passively investing, are we going to see reduced competition within industries...

I read an article a while back, wish I could find it. It was about how CEO compensation is often tied to absolute performance as opposed to performance relative to the whole industry and how passive management actually prefers this so I'd say yes.

>How good is price setting if there are less and less actively managed funds? Are there new inefficiencies that are created by all this passive investing?

Well Shiller PE is getting up there. I think this is super interesting because in our next correction or perhaps even now, as we move to an increasing rate environment, we will get to see some analytical minds actually beating the market. It's gonna be interesting.

Re:At Blackrock, machines are rising over managers to pick s... by prostoalex on Sunday April 02, 2017 @05:14PM (#14019081)
Social aspect of this are also interesting. We use the stock ticker as a reward and punishment for the companies involved, so introducing a new product that sells in unexpectedly large quantities generally leads to the stock price going up, while any bad news, e.g. pollution, poisoning, product recall, illegal behavior by the exec generally lead to a sell-off.

In an index-centric world if neither of the events cause the company to leave the index, I wonder if we'll still see such price adjustments.

Re:At Blackrock, machines are rising over managers to pick s... by inthewoods on Sunday April 02, 2017 @11:40PM (#14020454)
The really interesting social aspect, to me, is that we have a huge number of people in the US that are concentrated in the financial sector around active management. What happens to all those people? Are we about to see a huge downsizing of the financial industry?
Re:At Blackrock, machines are rising over managers to pick s... by prostoalex on Monday April 03, 2017 @02:47PM (#14025825)
Is the number huge, though? Retail stock-picking is done through mutual funds and active ETFs, which are typically owned by a larger outfit like Blackrock or Franklin Templeton, so the active stock picking is done by a select few managers of the fund. If that goes away, Blackrock or FT can still sell indexes and variety of bond funds.

On the hedge fund site extreme churn is fairly typical and considered part of the job. Well-known pickers (known mainly due to their windfall successes of the past and survivor bias) like Stephen Cohen, Carl Icahn and John Paulson are motivated less by the need to live paycheck to paycheck and more by the gambler's high.

Re:At Blackrock, machines are rising over managers to pick s... by blazespin on Sunday April 02, 2017 @06:02PM (#14019293)
Computer stock pickers look at balance sheets, p/l statements, etc. if anything the markets will become more rational and less prone to bubbles.
Re:At Blackrock, machines are rising over managers to pick s... by hendzen on Sunday April 02, 2017 @06:52PM (#14019497)
Computer stock pickers generally don't view balance sheets, P/L statements and other fundamentals data in isolation - they match them up temporally to historical market data and try to model what the effect of future financials releases will be on the price of the relevant security. If markets are historically irrational w.r.t. fundamentals, due to human falliability, or whatever else, our machines seem destined to repeat our mistakes.
Re:At Blackrock, machines are rising over managers to pick s... by Danylon on Monday April 03, 2017 @11:49AM (#14023706)
Is a mistake still a mistake when it is a profitable action?

If fitting to human irrationality increases generalization performance, then it does not matter if the "machines seem destined to repeat our mistakes", it is still a useful signal. If fitting to human irrationality decreases generalization performance, your algorithm is overfit to noise (and you have bigger fish to fry than human irrationality).

Overfitting to noise is perfectly avoidable, not pre-destined when part of your data is noisy (noisy data is the rule not the exception).

Re:At Blackrock, machines are rising over managers to pick s... by eru on Tuesday April 04, 2017 @01:44PM (#14035335)
Why? If the robot sees a historical parallel to a popped bubble---the robot might anticipate the popping short-sell now?
Re:At Blackrock, machines are rising over managers to pick s... by simo7 on Sunday April 02, 2017 @06:11PM (#14019338)
Algorithms look at the very same things humans look at. They will try to time the market and speculate as much as now or even more.
Re:At Blackrock, machines are rising over managers to pick s... by Danylon on Sunday April 02, 2017 @06:00PM (#14019286)
It's not a case of exclusive or. Gather a list of a 100 or so human stock pickers. Train a model to predict the effect of following their suggestions (buy, hold, sell) to both identify which experts are most right, and which particular experts do well for particular kinds of stocks. This model will do better than random guessing, and quite likely, better than any individual stock picker.
Re:At Blackrock, machines are rising over managers to pick s... by WalterBright on Sunday April 02, 2017 @09:01PM (#14019949)
Algorithms that predict the past accurately but are no better than random at the future are a dime a dozen, and I don't see how your suggested algorithm is different.
Re:At Blackrock, machines are rising over managers to pick s... by pizza on Sunday April 02, 2017 @09:02PM (#14019954)
Corollary: having a time machine that can go a few minutes back in time is worth much less than one that can go a few minutes forward in time.
Re:At Blackrock, machines are rising over managers to pick s... by Danylon on Monday April 03, 2017 @10:54AM (#14023154)
This implies the time machine can go only one way. Taking information from the future back in time is worth more than taking information from the current to the future. We do the latter all the time, we do not need a time machine for this, just patience.
Re:At Blackrock, machines are rising over managers to pick s... by Danylon on Monday April 03, 2017 @10:52AM (#14023141)
Then look at backtesting. The evaluation data set is out of time, meaning the better than random performance is on unseen future data. The algorithm was implemented, not merely a suggestion.
Re:At Blackrock, machines are rising over managers to pick s... by aoeuasdf1 on Tuesday April 04, 2017 @03:38AM (#14030350)
You can still leak information from your backtested time series by choosing WHICH algorithm to use out of a large pool of algorithms. You'll get regression to the mean because you optimized for a noisy signal (backtesting performance) of future earnings.
Re:At Blackrock, machines are rising over managers to pick s... by Danylon on Tuesday April 04, 2017 @12:36PM (#14034544)
It is possible to leak information, but then you are doing it wrong. Don't use only a single out of time test set to do parameter or model selection, keep an out of time holdout set.

But really, this is the bare basic of forecasting. It is somewhat annoying to have to regurgitate all of this: Like non-leaking forecasting is impossible somehow. It would be a better discussion if everyone just assumes proper forecasting practices. Instead people seem to assume I have no clue what I am doing, discarding my technique, because I did not mention removing duplicates, scaling, proper validation techniques, ... and a 100 other things, which are of no importance to the technique itself.

Re:At Blackrock, machines are rising over managers to pick s... by simo7 on Sunday April 02, 2017 @06:17PM (#14019373)
So you're basically saying the model should identify which human stock pickers to follow for each sector?

If it's so easy why not to identify directly which stocks to invest in?

If you can predict which investors will perform well, then just try to predict which stocks will perform well directly.

Re:At Blackrock, machines are rising over managers to pick s... by Danylon on Sunday April 02, 2017 @06:45PM (#14019468)
> If it's so easy why not to identify directly which stocks to invest in?

It is not easy. Both to set-up, and the problem itself (you won't get a very high accuracy, but you will get much better than random guessing).

> If you can predict which investors will perform well, then just try to predict which stocks will perform well directly.

This won't work, because you don't have access to all the information that the stock pickers have access to, just their advice, and some features about the stock / the company the stock pickers work for.