News for hackers. Stuff that matters.
Re:Prediction of the FIFA World Cup 2018 – A random forest a... by everdev on Tuesday June 12, 2018 @08:45PM (#17299350)
My biggest problem with these predictions is retroactive analysis of the prediction itself. If I have Brazil at a 99% chance to win the WC and they win, is my model the best?

I guess the idea is that over time, you measure prediction performance, but models are constantly changing and there's enough time in between WC tournaments that it'll take at least a century to have a good sample size of predictions.

If you take something more immediate like predicting tomorrow's stock prices or even the market (up/down), I wonder how their prediction models would fare.

Re:Prediction of the FIFA World Cup 2018 – A random forest a... by jamesrom on Wednesday June 13, 2018 @06:50PM (#17307682)
Yep, using many predictions you can calculate a 'brier score' which is a measure of your predictive performance.

https://en.wikipedia.org/wiki/Brier_score

See also: https://predictionbook.com