News for hackers. Stuff that matters.
Re:Jane Street Market Prediction ($100k Kaggle competition) by paxys on Tuesday November 24, 2020 @03:28PM (#25202655)
Why do you think this competition will result in a model superior to what Jane Street is running?
Re:Jane Street Market Prediction ($100k Kaggle competition) by 2-tpg on Tuesday November 24, 2020 @04:21PM (#25203134)
The winner model will likely outperform anything that Jane Street could come up with this 130 feature set. With 3000+ competitors, the top 10 will likely be superior to what Jane Street can do in-house. Then an ensemble of the top solutions will be the best possible model anyone can come up with.
Re:Jane Street Market Prediction ($100k Kaggle competition) by quantumofalpha on Tuesday November 24, 2020 @06:24PM (#25204222)
On a frozen feature set and evaluation dataset, sure. 3000+ competitors vs a few employees at JS who prepped this data. In light of very noisy data, the chances are not really on JS side here. But would the best model still be as useful on novel out of sample data is very questionable

Market prediction is low signal-to-noise problem, what's much more likely the contest will be an exercise in overfitting and the final shake up will be yuuuge.

Re:Jane Street Market Prediction ($100k Kaggle competition) by mijoharas on Wednesday November 25, 2020 @08:57AM (#25209234)
I'm just fairly skeptical of this comment.

I understand that there are more models being thrown at the solution space, but if you think about people at jane street, while they don't have 3000 employees working on these, they've got a few hundred, and then if you think about the _time_ they spend on (the real, not this kaggle competition simplified stuff) models, I think there's a good chance that they'll have a significant advantage in man-hours (it's a full time job).

Also, while there is a high standard to people doing kaggle competitions, I think you can easily discard >90% of them as not being super competitive, then your 3000 models becomes 300, and those 300 have less than 1/3 of the time spent on them that jane street-ers are spending on their models.

(I realise it's not an apples to apples comparison, as the models they're working on are different since this is a toy example, but you said "will outperform anything that Jane Street _could_ come up with)