News for hackers. Stuff that matters.
Re:Numerai – A hedge fund built by a global community of ano... by lordnacho on Sunday October 16, 2016 @02:15PM (#12720012)
Hedge fund guy here.

- You need to know something about the domain in order to make sensible predictions. Is the data daily? Is it per second? Is it ticks? You can't build a sensible model if you don't know that, even if you have good predictions. Relative cost will vary a lot between timescales.

- It matters what the features are. Maybe there's some clever reason why it doesn't, but until I hear why I'm going to take the ordinary view that some features are different in nature to others. For instance maybe one feature is volatility, a thing we typically model with GARCH, while another is some fundamental like P/E, which we'd incorporate some other way.

- How are you executing the trades? It matters a lot whether you're click-trading through some broker API, automating via Excel, or running your own network of colo servers. Some things just aren't possible if you're too slow.

- If you make the data encrypted, you'd better know very well what it represents. For instance, you might take all the closing prices of the LSE stocks on a given day as inputs. You can make analyses that are valid with that, and ones that aren't, because the data you've collected do not represent a snapshot of the market at a specific time. It might sound like it does, but it doesn't on deeper inspection (market opens and closes are not simultaneous).

Does anyone know how it's going for them?

Re:Numerai – A hedge fund built by a global community of ano... by solaarphunk on Sunday October 16, 2016 @05:49PM (#12721182)
Although numerai could control for some of the factors that you mention above, I'm pretty sure they are falling into the data-mining fallacy that most people do when they approach quantitative trading from the outside world. I completely agree with your skepticism of their approach.

While prediction based on data may be valuable in some cases, it isn't robust enough to scale up in any meaningful way. Context matters, like you state above, and most quantitative traders start by taking their contextual knowledge of the markets, and then collecting data on features, and THEN they fit a model to it.

Skipping these steps is only going to lead to a bunch of blowups. I doubt they have any meaningful sharpe that they could scale up or publicly defend with the approach they have taken so far. I'd guess they are paying people VC dollars, not actual market profits right now.

I do think its cool that they have been able to use homomorphic encryption to solve the problem of wanting anonymize data, but I'm not sure it actually helps in this case.

Re:Numerai – A hedge fund built by a global community of ano... by botexpert on Monday October 17, 2016 @01:09AM (#12722795)
Knowing what features represent is an advantage but isn't necessary. At least that's what nn research shows. But currently a lot of data of required for good representation learning. Ensembling also works, or can work, and it seems that's what they're doing. Although it doesn't look like datasets are large enough for NNs out that ensembles are large enough for good prediction.
Re:Numerai – A hedge fund built by a global community of ano... by numbas on Sunday October 16, 2016 @02:39PM (#12720183)
You don't really need to know what the features mean to make a good model. Even if only you knew the meaning of the features you'd still get beaten by someone using a blackbox approach. This is exactly what happened to the owner. He worked as a quant making predictions on this expensive dataset, and in the first tournament he was beaten by around 50 other modelers using anonymized features.
Re:Numerai – A hedge fund built by a global community of ano... by fixxer on Sunday October 16, 2016 @04:41PM (#12720812)
Based on the contest (weekly submission) and data (binary classification), it is my guess that they are running a long-short equity portfolio with weekly rebalancing. The features are known ahead of time and the dataset is not BIG, so I think some sort of fundamental approach.

Im not optimistic...

Re:Numerai – A hedge fund built by a global community of ano... by hal9000xp on Monday October 17, 2016 @04:51AM (#12723507)
I think hedge fund's founders motivation behind this idea could be like this:

Let's give many people some [encrypted] data to play with. May be someone will find a curious and unexpected pattern we didn't looked at before. May be this idea won't be workable straight away but we [hedge fund] are going to investigate this idea further and probably use this in our trading strategy.

In short, they are probably doing ideas mining using power of crowd.

Re:Numerai – A hedge fund built by a global community of ano... by muton on Monday October 17, 2016 @05:06AM (#12723563)
From the competition rules: "You retain all intellectual property rights to your model. You never have to tell anyone how you built it and you never have to tell us who you are. You only upload your predictions."
Re:Numerai – A hedge fund built by a global community of ano... by dsacco on Sunday October 16, 2016 @02:21PM (#12720053)
I don't know how it's going for Numerai, but I'd be interested in picking your brain a bit. If you don't want to put contact info in your profile, do you mind shooting me an email?
Re:Numerai – A hedge fund built by a global community of ano... by jamez1 on Sunday October 16, 2016 @05:28PM (#12721086)
Your constraints are rather simplistic given the people behind this. It is possible, that all of the factors you've just described, are encoded in the data set.