Re:Predicting outcomes for games of skill by redefining what...
by morelandjs on Tuesday February 06, 2018 @05:06PM
(#16320354)
I didn't know about this, thanks. In the paper (long read I know), I use a modified quantile-quantile test to demonstrate that my predicted uncertainties are accurate.
Essentially, if you make 100 predictions, the Brier score will measure how well you are able to make precise predictions. If you always estimate the odds that X will win to be 50/50, you won't do nearly as well as someone who correctly predicts the outcome each time.
https://en.m.wikipedia.org/wiki/Brier_score