Re:Prediction of the FIFA World Cup 2018 – A random forest a...
by jamesrom on Wednesday June 13, 2018 @06:50PM
(#17307682)
Yep, using many predictions you can calculate a 'brier score' which is a measure of your predictive performance.
https://en.wikipedia.org/wiki/Brier_score
See also: https://predictionbook.com
I guess the idea is that over time, you measure prediction performance, but models are constantly changing and there's enough time in between WC tournaments that it'll take at least a century to have a good sample size of predictions.
If you take something more immediate like predicting tomorrow's stock prices or even the market (up/down), I wonder how their prediction models would fare.