News for hackers. Stuff that matters.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by DevX101 on Friday November 09, 2018 @12:04PM (#18415905)
I'm not a purist believer in the efficient market hypothesis. BUT, I doubt there's much alpha to be gained simply from looking at price data which is widely and publicly available. Also keep in mind that markets are dynamic feedback loops so even if this model had an edge, the act of publishing this article would work against you to neutralize that edge in the future.

There's a good reason the most successful 'quantitative' trading fund, Rennaisance Technologies is so secretive and subjects its employees to a lifetime NDA/non-compete.

If there is edge in the market (and I think there are anomalies that can be traded on), I would assume it to come from correlating proprietary datasets with price. Or datasets that have a high barrier to access/analyze. One example that I'd bet still works in some industries would be counting trucks from a supplier to estimate product demand before the companies announces earnings ;)

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by pcprincipal on Friday November 09, 2018 @01:14PM (#18416512)
I 100% agree with this as a Daily Fantasy Sports player who has published some blog posts and code related to strategy. Any success I've had has been in sports and formats that are not popular and I purposely do not write or open-source code on. Edge can go away almost immediately; I saw this firsthand in DFS when a number of websites came in with free tools that pros had been using for years.

I play in the stock market a little and my best wins have been on small cap stuff where I've had some edge with unique knowledge of the industry and have taken the time to read SEC filings / keep tabs on earnings reports / closely watch competitors, acquisitions, etc.

To be clear, I still think this article is great from a learning about Keras perspective. That said, to anyone who thinks building some ML models and outperforming the market is easy, remember that edge is only as good as the number of participants in the market who don't have it.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by tomazio on Friday November 09, 2018 @02:40PM (#18417234)
I'm very interested to read some of your blog posts related to strategy/code around DFS, but I don't know what your blog is. Would you mind posting a link to one of these posts?
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by pcprincipal on Sunday November 11, 2018 @05:23PM (#18429040)
Definitely, sorry for late reply. Here's a few:

- Pick Em strategies on DraftKings - https://medium.com/draftfast/evaluating-possible-strategies-...

- Thinking in multiples - https://medium.com/draftfast/thinking-in-multiples-7e7c76ee2...

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by alehul on Friday November 09, 2018 @12:44PM (#18416273)
Rentech and the other more secretive top quant firms such as TGS and PDT use nearly exclusively public data.

Funds like Two Sigma that haven't had as good (or scalable) returns are actually the ones that focus on novel data sources.

In reality, everyone in this industry is drowning in data, and the real edge comes from learning how to more efficiently parse and analyze data rather than acquiring more of it. The top performing firms work at a level where the data is merely an abstraction; above-market returns can be achieved from nothing but public data sources, if you've automated the process of extracting signals.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by martinlaz on Friday November 09, 2018 @02:02PM (#18416939)
These are bold claims with nothing to support them. Given the claimed secrecy, I don't see how you could possibly know all that, unless you are (or have been) working for Rentech, or one of the others. Is that the case?
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by thwy12321 on Saturday November 10, 2018 @12:02AM (#18420049)
Funny things I've heard about Two Sigma. Everyone on the outside: Two Sigma is the best. People at the top of the financial industry: Two Sigma is cheesy.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by throwawaymath on Friday November 09, 2018 @12:58PM (#18416388)
I'm pretty sure that lifetime NDA is a myth. It gets repeated very often (like a lot of the Renaissance mythos) but I haven't seen evidence for it, and on its face it sounds flagrantly unenforceable. It could be that the compensation alone substantially reduces turnover. Likewise once they've hit "their number", employees may decide to go into tech or philanthropy instead of a competing firm.

For what it's worth, Renaissance (remarkably, in my opinion) advertised a role in the most recent Who's Hiring thread.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by ttobbaybbob on Friday November 09, 2018 @01:18PM (#18416537)
The NDA/non-compete may not enforceable, but if Renaissance believes employees with valuable IP are being poached, they will sue and make it very expensive to hire, then defend, ex-rentec employees.

https://www.marketwatch.com/story/renaissance-millennium-set...

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by JumpCrisscross on Friday November 09, 2018 @02:01PM (#18416922)
They’re totally up front about this requirement, too, when making offers. (Source: I turned one down.) You are to move to Long Island, buy a house, buy into the employees-only fund and work there for the rest of your financial career.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by throwawaymath on Friday November 09, 2018 @03:24PM (#18417647)
That's interesting. Did you apply, or did they find you? I could see that offer being attractive.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by WrtCdEvrydy on Friday November 09, 2018 @02:05PM (#18416967)
LOL, No.

How do you even enforce that? If I get a job somewhere else, there's no reason for me to disclose where I'm going.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by JumpCrisscross on Friday November 09, 2018 @03:30PM (#18417708)
> How do you even enforce that?

By suing your new employer for $20 million [1].

(On the other side of the coin, they offer like a month of paid vacation a year, plus longer sabbaticals every few years, plus tons of benefits...if Long Island and math are your thing, it's a very nice place to work.)

[1] https://www.marketwatch.com/story/renaissance-millennium-set...

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by qaq on Friday November 09, 2018 @02:54PM (#18417362)
They will prob run regular checks and you are prob. signing off on them having a right to do so.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by everdev on Friday November 09, 2018 @12:09PM (#18415950)
These predictions can also be self-reenforcing. If enough money believes the model is accurate, it will create it's own market conditions. In a distopian AI stock prediction world the best model will be the one with the widest publicity and adoption, not the best data points.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by aggronn on Friday November 09, 2018 @12:45PM (#18416281)
The problem I see with that hypothesis is that the asset pricing must eventually be tied to actual performance--while it may be self-reinforcing to some extend, if it _is_ fundamentally wrong, there will be a reckoning and an adjustment after a high value stock goes bankrupt, for example.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by derefr on Friday November 09, 2018 @01:51PM (#18416826)
But the stock market isn’t just a bunch of people placing speculative bets about company performance; it’s a bunch of people placing speculative bets about company performance by buying shares of the companies. If the market is irrational, it can actually prop up companies that would otherwise go bankrupt.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by aggronn on Friday November 09, 2018 @02:10PM (#18417007)
I suppose they company could continuously issue stock in this case.

But in this world, it actually makes sense for those companies to stop doing their normal business and just go into the business of selling their shares.

This reality sounds absurd, but you could argue that BTC market is there. Enough of the market thinks that "always buy" is a good investment, regardless of the real-life value of the asset. Or maybe, less controversially, gold is that market. Any asset that is always increasing in value and not related to the real value of that asset is just a store of value.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by candiodari on Saturday November 10, 2018 @07:09PM (#18424246)
Both of those things have valid services that I pay for.

BTC provides a number of services. From money changing and international money transfers to actual investment brokerage. Granted, the number of securities available in BTC is less than spectacular, but it's not zero. I pay for both those services. Now you may argue that those are unregulated services and therefore have trust issues, but one might argue that all markets have trust issues, and the only difference is the level. BTC, so far, seems to be more trustworthy than, for instance, the ECB (e.g. the Greek payment limits and the Cypriot bail in, one of which affected me, and both of them used MY money to achieve political aims, without my approval).

Gold provides a store of value, with a good story behind it. I pay my bank, I believe, around $40 per year for that same service. With frankly, not as good a story behind it (as I trust my bank less than I'd trust a bar of gold under my pillow when it comes to still having value tomorrow. Not that I have the kind of spare change to make that a pressing issue, but ...)

So given that both BTC and Gold provide services that clearly people are willing to pay for, who's to say they shouldn't have a valuation based on that income like every other financial service provider in the world ?

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by nradov on Friday November 09, 2018 @03:44PM (#18417845)
That effect doesn't go very far. It can slightly reduce a company's cost of capital but won't enable them to be profitable over the long term.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by Symmetry on Friday November 09, 2018 @01:34PM (#18416681)
Generally when talking about price movements the opposite is true. That is a prediction that the market will move at some point in the future will cause that move to happen right now instead, but only if that prediction is believed.

And if you have a model that people believe which predicts the movement of stocks but doesn't have any good reason for those predictions then it may very well move the price of those stocks in the ways that it predicts. But in doing so the money of the people who believe its predictions will be transferred to the people who don't until it stops having an effect.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by joe_the_user on Friday November 09, 2018 @04:08PM (#18418050)
If enough people believe a given model and use it, it would actually tend to make the model over and under-predict. If a lot of people think the market will go up, it's race to buy before the others and eventually a race to sell before the others when either expectation shift or all the buyers run out.

Which is say, belief in a direction can make the direction happen but belief in a particularly shaped curve won't make the market resemble that curve.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by T-A on Friday November 09, 2018 @01:26PM (#18416616)
"A research scientist and senior level employee who worked out of his Pennsylvania home […] His noncompetition agreement prevented Magerman from working for one year after leaving Renaissance for any firm engaged in the business of mathematically-based trading of futures and securities." [1]

Not quite lifetime, unless they expected him to drop dead within a year.

[1] https://www.forbes.com/sites/nathanvardi/2017/05/08/inside-t...

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by auntienomen on Friday November 09, 2018 @05:22PM (#18418558)
Magerman was an early employee. Not sure his agreement would be typical.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by SEJeff on Friday November 09, 2018 @12:06PM (#18415918)
Rennaisance is one large quantitative trading firm, there are other bigger and more successful ones however. I happen to work for another very large and successful quant trading firm.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by turingcompeteme on Friday November 09, 2018 @12:35PM (#18416191)
Bigger sure, but can you point to one that has had better performance than the medallion fund?
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by SEJeff on Friday November 09, 2018 @12:50PM (#18416324)
Most of them aren't hedge funds, they're private (HFT, Electronic Trading, Botique Firms, Proprietary Trading are all terms you'll hear) so they don't have public data. It is literally impossible to prove without insider information.

However the Virtu Financials, the Citadels, etc, will always exist, and will be doing exceptionally well whether people realize it or not.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by throwawaymath on Friday November 09, 2018 @01:00PM (#18416401)
Yeah, a better name for these kinds of funds is "independent research groups." Edgestream is an example of another. Renaissance is the most (in)famous one, but many others exist which profitably manage tens to low hundreds of billions while employing only 10 - 100 people.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by turingcompeteme on Friday November 09, 2018 @01:20PM (#18416560)
I realize this doesn't actually matter and I feel weird defending Renaissance... but Virtu is a public company and hasn't been doing that well, and returns from Citadel's various funds are not hard to find. Also, I don't know how to compare a fund's returns to that of a private business. But Medallion has been around since before HFT was really a thing, and I'm not aware of any HFT places that have been growing at 70% a year for 20 years.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by sseveran on Friday November 09, 2018 @03:22PM (#18417624)
These are wildly different businesses. Virtu is a global electronic market maker which in reality is more like a mature technology company than a risk taking hedge fund. Renaissance (Medallion specifically) is a weird fund that manages employee money. Citadel is a large, diversified financial services company that happens to have overlap with both of the previously mentioned firms. They have a large market making operation and offer a variety of different hedge funds that they market
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by just_some_guy10 on Saturday November 10, 2018 @09:09AM (#18421381)
It's not unheard of for market makers to have returns well above 100%, and one you get into certain latency arbitrage strategies the returns can grow significantly.

The issue is that these business are capital limited, so you can't reinvest your massive returns to compound them.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by a9entroy on Friday November 09, 2018 @12:11PM (#18415966)
Which company would that be?
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by d3ld0t on Friday November 09, 2018 @12:15PM (#18416002)
jump
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by SEJeff on Friday November 09, 2018 @12:16PM (#18416007)
yup
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by C1sc0cat on Friday November 09, 2018 @12:18PM (#18416027)
A lifetime noncompete really I assume they pay you for life for this noncompete.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by DevX101 on Friday November 09, 2018 @12:23PM (#18416064)
My understanding is that legally, the contract says something reasonable, like a year. But the firm will use it's considerable resources to impede your career if you attempt to work in mathematical trading after that year's up.

On the flip side, employees are compensated very well, and the turnover is very low.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by jermaustin1 on Friday November 09, 2018 @12:33PM (#18416175)
I'd assume turn over is low if by leaving they now have to change entire career paths. I'd put up with a lot of shit to not have to learn a brand new trade.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by abakker on Friday November 09, 2018 @12:39PM (#18416225)
They make SO much money, though, and get access to the special employees-only fund, so I assume that employees that join are interested in staying.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by argonaut on Friday November 09, 2018 @02:06PM (#18416971)
They don't. They're all qualified for machine learning or data scientist roles in any area of tech. That's a huge field.

Most of them are also qualified for general software engineering roles; some of the people with more theoretical backgrounds might not be.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by smaddox on Friday November 09, 2018 @02:59PM (#18417407)
If that's true, it's only a matter of time until they get sued and lose a large class action suit.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by lifeformed on Friday November 09, 2018 @12:51PM (#18416339)
Well, being an employee gives you exclusive access to the best fund in existence by far (35% return every year for decades). Nobody is going to want to kill their golden goose.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by woah on Friday November 09, 2018 @01:33PM (#18416679)
Extreme secrecy plus consistent very high returns sounds like the hallmarks of a ponzi scheme
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by auntienomen on Friday November 09, 2018 @04:50PM (#18418343)
The fund contains only employee money. That's a very clever ponzi scheme if it is one.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by nabla9 on Friday November 09, 2018 @01:04PM (#18416430)
> Rennaisance Technologies is so secretive and subjects its employees to a lifetime NDA/non-compete.

Medallion fund is profit maker but their strategy is obviously very size limited. Their strategy does not scale.

Betting syndicates can make similarly massive ROI, but they are very growth limited.

Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by JohnJamesRambo on Friday November 09, 2018 @01:07PM (#18416452)
What is a betting syndicate?
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by TomK32 on Friday November 09, 2018 @01:17PM (#18416534)
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by csomar on Friday November 09, 2018 @12:51PM (#18416332)
There is tons of opportunities in smaller markets that RT or others have no interest in, however.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by steve19 on Friday November 09, 2018 @12:12PM (#18415977)
How does a lifetime non-compete work?
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by 0003 on Friday November 09, 2018 @12:18PM (#18416032)
They kill you.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by conanbatt on Friday November 09, 2018 @12:35PM (#18416196)
Well, if it's in the contract..
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by hhmc on Friday November 09, 2018 @12:16PM (#18416011)
I'm shocked that would be even close to enforcable.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by poulsbohemian on Friday November 09, 2018 @05:02PM (#18418423)
I don't know anything about the finance industry, but it seems to me that there are a number of industries where the non-compete term is irrelevant, as you can still become persona non grata. For example Companies B, C, and D know that if they hire someone from Company A, they will get sued. The merits are irrelevant if Company A can outspend them relative to the value of the prospective employee.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by C1sc0cat on Friday November 09, 2018 @12:19PM (#18416038)
Me too I suppose if you where payed for life to not work in the field and would probably not be enforceable.
Re:Using a Keras Long Short-Term Memory Model to Predict Sto... by mark212 on Friday November 09, 2018 @01:50PM (#18416811)
don't worry, it's not. Even in New York, has to be limited in time and geographic region. Good luck getting more than a year.